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ABSTRACT 


This timely work concerns itself with a methodological 
investigation of the complex phenomenon of threat assessmema 
at the Defense Department level. Through the device of 
propaedeutic and heuristic discussion the controversial 
aura surrounding present day threat assessment is explores 
Several methods that have been used or might possibly be 
used to assess threat are outlined. The paper concludes 
with the optimistic remark that with further effort a 
pragmatic and reproducible method of assessing threats to 


thisedapion should be forthcoming. 
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IT. PREFACE 


The author was first attUrectedmco vunis siege, Cima 
lack of documentation dealing with the subject of threat 
assessment methodologies and the cavalier construction of 
threat assessments in many studies. The original title 
which was envisioned for this work was "The Use of Subjective 
Factors in the Assessment of Threat." After this initial 
fmemulatcion, several weeks of research indicated thay finding 
Mmecvmods to utilize subjective factors in threat assessment 
Memeoottated finding out how threat was assessed in current 
meeares, The research was then reoriented and the title was 
emaneed to read "The Assessment of Threat as Praeticed in 
Systems Analysis." However, further research uncovered that 
no cut-and-dry method existed to assess threat and certainly 
no method had been constructed to specifically handle this 
eomenex problem. Thus, through this process the author 
finally entitled this paper "An Investigation of the Assess- 
ment of Threat." This title implies an uncovering of methods, 
emone@ Other things. In this sense, the implication was true. 
ints paper certainly did not find existing threat evaluation 
procedures profuse in the literature or methods that were 
universally accepted. The research effort presented evidence 
Siea miasma of concepts, methodologies and philosophies that 
Smee interpreted as methods used to assess threat. A dis-— 
Cussion of why these concepts, methodologies and philosophies 
prould be used to attack the assessment of threat was never 


Hound in the Literature. 


Pie mGemeuriction of this paper and the ordering of time 
arguments into the particular sections that follow was pre- 
NeGieawoameanad purposeiul.  sectiajon ILigethe introductory 
S€ctton, was intended to entice the reader to go on by wemoe 
senting the fundamental motivation of this research whiea 
was the proper allocation of defense resources. It further 
served as an introduction to the writing style sof the 
author. Section II1l informs the reader of the author's 
perspectives which guided the research for this paper. 
Section IV serves as a propaedeutic and a heuristic base for 
discussion of the nature of the problem of threat assessment 
in the next section. Section IV touches on the myriad factors 
that plague defense planners concerning this problem and 
attempts to give insight into why these aspects are relevant 
when dealing with threat assessment. Unless the reader has 
successfully coped with the assessment of threat, the reading 
of Section IV cannot be omitted. Section V describes the 
nature of the problem of threat assessment and emphasizes why 
this nature cannot as yet be fully outlined. Section jim 
covers five categories of methods that classified present 
methods that have or could have been used in the assessment 
problem. The last section presents the conclusions, recom- 
mendations and proposals for further research that the@e2aeew 
generated. 

Almost all readers will understand every theme contained 
in the introductory-.and perspectives sections (Sections II 


and III). The discussion section (Section IV) should bring 


the average reader to the tentative conclusion that the 
problem of threat assessments omc miriam Ih Si @ emo olioh- ae eme 
Selved at this time. The section dealime with The presleom s 
nature (Section V) should again reinforce this tentative 
eemelusions It iSethe author'Sehope thateiee Netlie@omsecrl ion 
(Section VI) will allow the reader insight into just how one 
fl'eeecome tO grips with threat assessment in the iuvure. 
Hew~emilly, this section will force the reader to reassess his 
femcatvive c@nclusions concerming the impossibility of prop- 
mamey assessing threat. ‘Whe concluding section may serve as 
Eee ringboard for further thesis research at the Naval Post-— 
peaaquate School. 

mie preceding pmedictions Of the reader "s reacvions to 
mmemoaper are parallel to the author's reaction during the 
femomet Of the research and writing of the paper. At this 
fewer a sense of optimism affects the author concerning 
@iemucrure development of an adequate method of threat 


assessment. 


IT. INTRODUCTION 


secretary of Defense Melvin R. Laird said today 
the United States wiiliehavyve seo CoOmeader possmbile 
production of a new strategic bomber or deploy more 
strategic missiles at sea if the Soviet Union's 
offensive threat continues to mount.1l 


Senator William Proximire said today that mil- 
itary spending should be cut by $10 billion. "We 
found from expert testimony we took that the Russians 
are not ten feet tall," the Wisconsin Democrat said 
in releasing a report by a subcommittee of the Joing 
Economic Committee of Congress. Mr. Proximire is 
chairman of the subcommittee and vice-chairman of 
the parent panel. "In fact, based on our military 
outlays and economic strength," he said, "If we are 
six feet tall the Russians by comparison are three 
feet tall and the Chinese are six inches tall." 

Mr. Proximire's assessment that the Soviet MiliuGanwe 
threat is half that of the United States was based 
on testimony of what the Subcommittee Report called 
eight experts on Soviet aifairs, who estimated 
Russia's gross national product at half that of @eme 
United States. "While it would be unrealistic to 
underestimate one's potential adversary," the report 
said, "The Subcommittee is disturbed by a tendency 
of some to magnify the strength of the Soviet 
military establishment. Expenditure of unnecessary 
sums for defense leads to misallocation of our own 
PesOurces and vnereitore weavers Unis Nation tems. 
omnis Cine e 


These statements are typical of the controversialwamm 


that seems to surround threat assessment today. The realis- 


tic quantification of threat, whatever threat may be, and the 


relation of this assessment to Department of Defense spending 


i Associated Press dispatch, The Monterey Peninsula 


herald. (California), Jemucmy a7 soo. 


- Associated Press dispatch, New York Times, December 28, 


1969. 
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and programseaus»pextreme | y edi Rieu Or Aiea ee eso — 
ealled experts are quack to present weir mernod et (dealing 
wach the problem.  Polmsiguead analystsesconmeo olay nel weoune 
mssian misslles dissect possible Aiea reese ey aes- 
missiles and through some thought process equate this anal- 
meas to the proper amount of missiles, troops, bomb shelters 
or whatever that must be acquired for Defense Department 
meecrans. Some miditary thinkers utilizingxexperience and 
maeement, make the same connection justifying their assess-— 
memb Witch historical examples and the assessment of potential 
enemies' possible intents. Most students of analysis of 
Seiemse spending admit nothing other than 4a threat exists atv 
some primitive and universally understandable level and pro- 
eo trom there with schemata to counter the threat. On the 
Pener hand, many dismiss all assessments with the exception 
Smene most general predictions, as looking into the fuvure 
and an impossible task anyway. 

eure navional resources and the annual budget hame am-=— 
Meee USCS in the areas of strategic defense, environment, 
Bepulavion control, urban renewal and of course, the prose— 
senor Of a very real, limited conflict, Viet Nam. An 
economist would say we are faced with maximizing "the problems 
solved" given a limited budget allocation. With the largest 
Permeion of the Federal Budget, the Defense Department offers 
eLmnope Of the greatest cutbacks and therefore. further 


meaoplicatiommof the budget to other critical problem areas. 


al 


Alain Enthoven emphasized that, "One simply cannot decide 
racionally on a national security policy independently of The 
iateiwae ive aspects of enemy capabilities."- The fundamental 
theme here is the more accurate the assessment of threat the 
less waste of resources to cope with it. 

This paper does address accurate threat estimation. (uae 
paper does not address the relationship between political 
decision-making and rational models based on accurate threat 
estimation. This paper does not survey methods used Diya 
Defense Department that address threat assessment, although 
The Papemgetmnerencly Gove heomem Ghem- 

This paper is not cast in the role of a methodological 
standard providing a basis for determining the exvencmeae 
which research dealing with threat is controlled and hemees 
scientific. But if there exists such a4 methodological saw. 
ard in systems analysis this paper is intended to assist in 
making explicit the conception of the best approach to) mama 
aSSe€ssment research procedures in an effort to facie aes 
future improvements in both the standard and one's efieigmewre 
approximate et 

In the end, the attempt to investigate possible methodol 
Oogy for verification of threat assessments is equivalent to 
the attempt to outline a scientific discipline of inter. 


country relationships. Do not take this paper so. BUGwiaiicg 


3 Enthoven, A. C., "Operations Research at the National 
Policy Level," A Modern Design for Defense Decision (Indus- 


trial College of the Armed Forces, 1966), p. 157. 


Nee R, b&., Scientific Method Optimizing Applied 


Research Decisions (John Wiley and Sons, Inc., 1962), pp. 6-7. 
lee 


take it as an attempt to preposition one's intellect to 
vilify anyone claiming its accomplishment. 

Thus, what can be answered by this paper is a function 
of the reader's interest in the problem and the value of 
eoping with research attempting to quantify threat. The 
endeavor was to provide propaedeutic and heuristic bases for 


further attempts at threat assessment. 


des 


Ue shinponeg a OMe NE Acie: 


iii Cig every =paper dso Wwrileten from personaly 
ascribed perspectives. The nature of the problem of threag 
assessment dictates an explanation of why these particular 
perspectives were set down. 

It is the contention of this paper that in many cia 
threats to this country seem to be well understood phenomena 
for the individuals concerned. For example, it seems suffi- 
client that the public of the United States be aware of the 
peneral nature of certain existing threats to this counmews 
This allows understanding of the legislative and polile@ a... 
esses that go on in relation to Countering these three 
However, knowledge of the general nature of threats TOm@ims. 
country is not sufficient for decision-makers who Cari 
something about threats. These considerations are Whyte 
perspectives were set down. The perspectives are [om miimg 
reader to adopt to insure the reader not to cling to Nitsmaam 
perhaps naive points of view. 

A perspective may be defined as the selection of a 
position from which to view something one is desirous of 
viewing. With the thought in mind that the something may be 
unviewable, the following perspectives were used to ViewerHe 


assessment of threat. 


A. DEVELOPMENTAL RESEARCH 


Research that is directed toward the solution 
of problems that can be divided into two major classes, 
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evaluative and developmental. An evaluative problem 

is one in which the alternative courses or action are 

completely specified in advance and the solution 

consists of selecting the "best" of these. A devel- 

opmental problem involves the search for (and perhaps 

construction or synthesis of) instruments which yield 

a course of action that is better than any available 

at the time. 

This paper is developmental research which is searching 
for methods that yield policies that are pragmatic in the 
sense that they realistically and rationally cope with threat 
assessment and successfully relate its quantification to 
Pmense spending. 

ihe nstudy.of sclientdtl ic methods .is frequently .refiemnred to 
as methodology. The objective of methodology is the improve- 
foie Ot the procedures and criteria employed in the conduct 
Seeoerentific research. For this reason, methodology is 
@efpen referred to as the logic of science. And for this 
reason, this particular perspective can be said to view the 


assessment of threat from the standpoint of the logic of 


threat assessment methods. 


Poem oUPDICTENCY OF SYSTEMS ANALYSIS 
The installation of systems analysis and its basis in 
Stewoitication, at the national policy aera prompted this 


investigation. Policy makers were thought to have been 


peas pot 


Hitch, C. J., "Development and Salient Features of the 
Programming System," A Modern Design for Defense Decision 


(Industrial College of the Armed Forces, 1966), pp. 84-85. 


1s 


driven to this method in order to have a surrogate for expe= 
rience because of increasing complexities which confronted 
them. It was felt the old patriotic emotional process 
supposedly employed in the past must take a back seat to 
intellectual processes such that one's attention is to the 
question Of whal Ss right. not who's right, 

It is abundantly clear that the Defense Department has 
acted as if a real and palpable threat existed and that with 
the tools at hand was able to justify its plans and programs 
in relation to this threat. It was not clear? that the meth- 
od of systems analysis was sufficient to adequately partake 
in this justification. Therefore, this perspective SouWeapeG. 
view systems analysis as practiced in the Department of De- 
fense with a critical eye in an attempt to evaluate its 


sufficiency as a method used in threat assessment. 


C. MEASUREMENTS 
Since the perspective of the sufficiency of systems anal- 
ysis was adopted it was in context to question the measure- 


ments one must have taken in order to quantify threat To 


i Quade, and Boucher, W. I., (ed.), Systems Anal- 
ysis and ee — (American Elsevier Publishing Cee 
ines, occ pee oom 

5 


Enthoven, A. C., "Choosing Strategies and Selecting 
Weapon Systems," A Modern Design for Defense Decision (Indus- 


trial College of the Armed Forces, 1966), p. 148. 


9 Green, P., Deadly Logic: The Theory of Nuclear Deter= 
rence (Ohio State University Press, 19 a sae: 
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practice systems studies. Jimi smpo°ok were dicen and 
Optimal Decision, Churchman has stated, 9All descrip tkon 
methodologically entails preédie¢ UG Wee et eee meas — 
urement takes place within the context of a theory. "19 
Churchman further argued that deciding what sort of measure- 
ment to take to represent concepts is essentially a decision- 
making activity. This implies measuring may not be properly 
located in the realm of systems analysis. Since the objective 
of measurement could be accomplished in several ways and was 
dependent upon one's decisions, could analysts decide what 

to measure or should decision-makers have been involved? 

Once this question had been resolved and measurements were 
attempted, one found no theory of measurements as a guide in 
maeconduct Of measuring.t? Analysts do not know why they go 
about quantification in the manner they do. Each one devel- 
oped his own theory and conducted his measuring from this 
basis. These perspectives took the place of a theory of 
thesis construction and were developed by the researcher. 

The method of systems analysis can be characterized as ways 

of creating on-the-spot theories to solve complex problems 

of choice. Were the theories of measurement constructed by 
analysts sufficient to characterize threat? This perspective 
was adopted to examine some of these theories. Again it is 
appropriate to cite Churchman. 


ae Churchman, C. W., Prediction and Optimal Decision 


(Prentice-Hall, Inc., 1961), p. 85. 


= Tit oO. 


uPy 


In other words, theories of science (in this paper, 
threat assessment) are not tested by a set of data 
arrived at independently of the theory itself. Data- 
collectors are not objective arbiters of truth who 
have never been embroiled in the disputes they arbi- 
trate. Data-collectors have used a theory to collect 
taemwie data. Unitiicationmot specif icuci fort mwoccurs 
when we can understand the relation between a theory 
and the theory of data collection used to test the 
theory.12 (Comments in parentheses mine) 
DD. BASIC SUBSE iy Sores CIlENTLIE LC sve MOD 

There exists primitive notions: in ourssocletye that genen= 
tific activity in generad sis aecold hardganalysieewies 
objective methods being utilized. Further notions deciam 
science as independent of the personalities involved.?? 
These notions were rejected in this paper. The fundamental 
subjectivity that partakers in seientific actdwit ywdiieg a, 
does bend and mold science in various directions. Scientific 
activity was thought of as a way of accomplishing some objec- 
Cive in a particular manner and invented and pursued by man- 
kind (with all that entails). As applied to all objectives, 
no value judgment was made as to whether science is better 
than common sense. Had this judgment been made prior to this 
paper, no need would have existed to write it. 


To use Ackoff's apt phrasing, the perspective adopted was: 


Quantification at any stage depends on quali- 
fication. What is qualified at one stage may be 


25 Sipe pa eee 
15 Fnthoven, A. C., "Choosing Strategies and Selectime 


Weapon Systems," A Modern Design for Defense Decision (Indus- 
trial College of the Armed Forces, 19 rs Oras le 
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Guantifiedgar another, BUibeal Gayeiewese Some 
qualitative judgements are Required: Conse 
quently, progress in science not only is a 
function of an dwereaseqdmceapacwe yr o ailanurcy 
efficiently (i.e., to measure) but also depends 
On an imcreased capacity Torgual] tyme! | tewemnEay . 
(Underscoring mine) 


14 


Once some ultimately right belief CTowardescientific 
activity is discarded and acceptance that all human activity 
is fundamentally subjective, one can then view the objectiv- 
itweot science as not how rightsor wrong it eis, but as what 
objectives science seeks to achieve. Clear precise objec- 
meres with well thought-out procedures to attempt their 
eecomplishment is the ultimate attraction of scientific 
Seem meoy. oclience attaches a sense to human existence and 
@mecers human activity to realize more quickly human objec=— 


bimmes. o0 do hunches. 


E. APPLICATIONS 

Analytic techniques of systems analysis can be applied to 
Sememse and military problems in a spectrum ranging from the 
ifomuaine to the vital one-time decisions of top-level national 
security decision-makers. This spectrum may be divided into 
the following categories: management of operations, choice 
of tactical alternatives, design and development of weapons 


JAS) 


Seemons and determination of major policy alternatives. 


This paper endeavors to perceive the problem of threat 
Mesessment from the viewpoint of the last two categories: 


Sysvems design and development and policy determination. 


14 Ackoff, op. cit., p. 21. 


i 


Huacde and Bovuenwenemeee. » C1000, sO Pama 
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IV. DISCUSSION 


A. GENERAL 

The fiscal year 1969 found the United States spending 
$79.16 billion on defense alone. Net expenditures for that 
same year of the national government were $184.764 eee 
More than forty-two percent of the nation's budget went to- 
ward defense. Defense against what? is one of the questions 
this paper investigates in an attempt to critically examine 
how we as a nation go about justification of this fantastic 
sum in the common defense. The defense against threats to 
this country is a complex problem area. This problem in- 
cludes the enumeration of threat in some manner. It may be 
that systems analysis and the scientific method cannot 
enumerate threat. But prior to this conclusion investigation 
is dictated into the sufficiency of systems analysismanmge@ru- 
theory underlying the method. 

For those who scoff at the implied premise that threat 
Can be measured, be reminded that the analysis of ie 
"unanalyzable" and the conception of the "inconceivable" have 


given great impetus to the progress of mankind. Be also 


16 1970 Information Please Almanac, Atlas and Yearbook 


(24cheed., GClmon ana Sehuster, Moc. pemrocr 
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reminded that concepts that are regarded as indefinable by 
the world's great intellects may imply the need to reorient 
the manner in which these concepts are regarded. The struc- 
ture of a complex concept may never be discerned but the 
tmecton of the concept in relation» to the purposes of man= 
Kind may be very helpful indeed.+! 
normexamp le, candeimaasptonmofethreat.usedminme rt hespe tence 
Department does not exist. Yet the Department uses functional 
relations to the concept of threat, which act as measures. 
These measures can then be used to justify expenditures in 
moeipeton to the threat. The very essence of the problem dis- 
cussed here lies in whether one may conceptualize threat. 
ihe problem of threat and the notion of its use as a primitive 
@emecpt will be taken up later. 

Systems analysis is initiated as a method because of the 
threat of impending competitive action. (This statement can 
be accepted if one disregards the troublesome area of threat 
definition.) The competitor in this case is a potential 
political enemy. System studies are also initiated to modify 
operational systems to take advantage of current develop- 
menoanl® Of course, one hopes the systems of the Defense 
Department are generated in relation to potential enemy 


threats. Finally, systems analysis can be employed because 


of orders of decision-makers. One can safely say that the 


1” Ackoff, op. cit., p. 171. 


16 Rudwick, B. H., Systems Analysis for Effective Plan- 


Meme: Principles and Cases (John Wiley & Sons, Incisy 1969), 
eee 14-15. 


en 


decision-maker in the Defense Department is probably (or at 


least should be) motivated by some form of perceived enemy 


potential to harm the United States. (To conclude then that 


all systems analysis activity is primarily based on some 


perceived threat is tempting, but quite naive. This paper 


will address this nexus between systems analysis and its 


iemrravion lacers 


This present discussion is biased toward 


the ideal that the defense establishment exists for the 


common defense of the United States. Using the word defense 


in this context necessarily brings to mind the word threat. 


Without threat one needs no defense and so on. What needs 


clarification here is that the Department of Defense is a 


human construction and organized and run by men. The Depart- 


ment's animation is a product of its organization and that 


organization's membership. 


The membership's interpretation 


of what the common defense entails is of interest here. 


This 
used 
then 


true 


interpretation and the 
wO carry Lesougwresult 
that no matter how one 


understanding of these 


actions (in the guise of programs) 
in national defense. It is clear 
defines defense or threat, the 


concepts in the Department of 


Defense lies in investigating the actions of the Depariier. 


to deal with then. 


In the past the programs and plans of the Departmeimuue: 


Defense have been scrutinized from every aspect. Dis@ue een 


then centered on whether these programs and plans in fact 


accomplished the common defense and effectively coped with 


the threat to the nation. 


The planning, programming and 


ee 


budgeting system has as its self=preoclaimed pulmpose UCmedmace 
projects to budget allocations and specific enemy potential. 
Critics seized on the comparison of these projects and their 
costs disregarding how they were generated. Congressional 
hearings go on today dealing with this veryesubjecctes The 
sejcee of this discussion is to present the reader with the 
fact that today the justification of defense plans and pro- 
meeames 1s logically dependent on perceived threat. AL this 
toms this dependency probably does not exist in a rmation- 
ally reconstructable manner. In other words, can government 
meeommers equate existent and proposed systems to some threat 
‘aeeeeoome reproducible method that can be followed by other 
individuals such that the same systems result? If this 
memendcency does not exist then necessarily by the previously 
Mmieloned reasoning thosewsame planners must not completely 
Paderstand either the organization of the Department of 
Defense, its membership, or its actual functioning, or all 
three. To make a conclusion about the preceding statement 
1s not the present object. The present object is to insure 
tiioeghc into the structure of the problem. 

petting aside the difficulties previously discussed con- 
Pemumae the understanding of the actual functioning of the 
meeeease Department, the relationship of_ the United States to 
potential enemies is taken up. This relationship is the 
main problem. If researchers could dissect the organization 
and membership of enemy governments, learn of their function- 


ing and its relationship as a potential threat to the United 


2S: 


States, the problem could be solved. Minimum expends tures 
could be arrived at straightforwardly to counter these 
threats. Unfortunately, our understanding of foreign estab- 
lishments is as far away as respective foreign researchers 
are in understanding their own country's organizations and 
motives. (One must at least suspect this to be true if De-— 
fense Department planners have the sort of problems indicated 
in the last paragraph. ) 

Where is the starting point then? Does one wait Uliuae 
a systems study is indicated in relation to some vague poten- 
Ciality to construct a theory of threat assessment CO SUpperL 
the study? Can one equate political analysis of one's” enemies 
to systems studies? What operational theorems does one have 
On Vat ehetio ral Pe pack? 

As previously implied no theory of inter-country relation- 
Ships in rigorous enough format exists to construct inputs to 
Systems studies. Many theories or disciplines, if you" }jaaum 
such as political science, deterrence theory, arms control 
and international relations exist, but they are incompatible 
with the present conduct of systems analysis. In fact, the con- 
Croversy which exists between the aforementioned disciplines 
in regard to potential threats is chaotic. Leaving the 
perspective of the government establishment, one is accosted 
by pamphlets, articles, books, Speeches, news reporting and 
all manner of voiced opinion relative to or PUrpOrt ing ew. 
assess potential threats to this country. The material 
available is staggering. Again, where is the starting powar 


for systems studies in relation to this material? 
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At this juncture it VWs"apprepiriave scem sce coma DOUL 
peinciples or laws of science. 7A pring Bolles enela Soma 
convenient way of recording a scientific observer's observa- 
Gions about some phenomenon. The activity of observing is 
a continuous one requiring reinterpretation of the principle 
Or law or they must be discarded as no” longer helpful. An 
analogy eS demonstrate this definmitrven as the oneweconcerning 
the ancient belief that the universe was made of fire, water 
and earth. This principle suited man until classical physics 
and more recently nuclear physics dictated its complete 
ffemuvavion. 

Now, similarly the laws concerning the behavior of 
foweeres Dresenting threats to the WUmited sSeates are con- 
merviers Of the observer of these countries. Consequently, 
maberaws Of Value, in order to réMmain valuable, must be capa-— 
be OL reinterpretation. To maintain one™s laws one reinter- 
prets. This methodological idea is credited to Kant who 
elaimed that we would not observe regularity in nature, had 
Pemier first put it there.?? It rollowsPthnat we would nov 
weer ve regularity in countries' behavior had we not first 
Puc it there. Making a round turn the observation that com- 
meee s this discussion is twofold. If one claims no laws of 
inter-country behavior, can one possibly observe this behavior 
accurately? Furthermore, can this behavior be observed with 


ememeh precision to be useful to system analysts? 


Lo Caurechman, OP. Clu. POwmc ties 5 
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herecumring theme in the present section has been shat 
thewbasiemmeor.ofedependence Ongaumbers and» measurements om 
Systems analysis makes this method incompatible with .othemr 
disciplines that traditionally have handled threat analysaise 
Quade and Boucher observe that: 


Today, analyses no longer look as "analytical" 
as they did in the past. To an increasing extent 
they deal with strategy as well as with tactics-— 
with the ability to achieve general fovea gn joommme 
objectives, rather than merely with the ability of 
weapon systems to influence the character of @ 
Single military clash. .. . We now realize that 
the impact of subjective considerations-such as 
the sestem's flexibility; its compatability wath 
other systems (some yet unborn), its contributions 
CO national presti 26 yabeead ea eshp seme TT CCemom 
domestic political constraints—can play as importame 
a role in the choice of alternatives as any calcuieae 
tion of war outcomes. In addition, we realize that 
such intangibles as the extent to whiechesuperhorigg, 
im residual forces can be effectively used to CGemen 
the enemy to discontinue the conflict or the percep= 
plonseach sideahas Of 1tbS i0own Or its enemy "s 
strengths, must be taken into account. @¥itws, it 
Soeur d De® surprise thal Many OF bie COMpDomcum 
studies and even a major part of the over-all anal- 
yells, are verbal rather than quantitative in nati 
(Underscoring mine) 








It must be submitted that these observations are essentially 
correct, but the embellishment of analysis with "verbal@rarnes 
than quantitative" reporting methods is begging the question. 
Rigorous (analytical) results and the complete repetition of 
results by other researchers using a study's methods aeeuam 
part the scientific method. Substitution of verbal anaes: 
of threat in place of striving to develop methods to me@iiige 
it, will never solve the measurement problem (or resolve it). 


Now analysts must wear two hats when dealing with threat 


20 
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assessment: one of a systems analyst, the other of a 
political scientist. Green [Ref. 7] is especially damaging 
me the reputation of systems analysts eabiial) ve sproperl, 
jon sene hat. of <mpoliticalgsementist . 

Pnade and Bewchermeerenero cite AlToOn mia. 


HKewever faaastrating and difficult mayebe the 
actempt to perceive and project the probable 
mabentions and behavilior»sof.a- potential.adversaery. 
pEeudence demands that the eciiort. be made. Onmily 
iimneg@eme appreciation of the other side's wmovives 
mmc SOMe MOULOM oOo. Une underlying. values worcn 
influence its decision-makers can we hope to 
induce behavior on their part That is favorable To 
us. . . . Obviously the policy-maker must use this 
Mma Ol GCualitavive research and analysis wilh che 
greatest caution. Since all the important variables 
mee Woe even Nave Deecm etGcevITIed , mem Less anal — 
eee eee in  Chatseworladsor Subj ecli vesprobabi li tases: 
epee -Cetined and personally ascribed scontidence 
Mevels, the invesi#ment of posations which cannot be 
scientifically verified may tend to distort the anal- 
mca l Contexts ;epo pollarize discussion alone 
Paeeseieies 4 Jaimes , end tOnpere Vel Us onerecul rem urocess 
(of analysis) into sterile controversy. Both analyst 
mee uUscremusy COnsStamuly CUard = arcainsy tame tneling rien 
Mmmeeorm UNjustifiably rigid convictions and to develop 
geeealse contidence Chat any particular model or 
solution accurately conforms to the real problems of 
politics and strategy.¢l (Comments in parentheses 
mine ) 


liijtemmevelopment of methods of identification of Alton Fry's 
"important variables" and measures of their ranges to an 
meres that policy makers could rely on systems studies 
dealing with "problems of politics and strategy" (or threat 
assessment) should be a major goal in systems studies. This 


goal should not be discarded because one is able to substitute 


eo Prey, Av "United states space Folicy ) in, haamp homers 
Folitical Analysis," Systems Analysis and Policy Planning 


(American Elsevier Publishing Co., 1968), pp. 322-323. 
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a well—turned phrase for its accomplishment, or because 
“prudence'ehas nots "demanded" convincinglyse2Dhis goal «siheuld 
pemolUri yen tor oem uUrther the horizonpot tie usefulness aan 
systems. analysis, and its product to, further the natatenall 
Getence. 

All too often, the definition of Ulhmeat ismmet taker 
seriously by scientists. The notion of threat as ae 
and primitive concept in need of no definition can bemic ee tas 
in one's everyday life only. At the level of national seer. 
rity threat, its definition takes on great importance. aaa 
nation felt threatened by Communism in Southeast As?a™ jew 
result, fantastic sums were allocated to prevent themaaimm.e 
theory from becoming reality. In Tact; at this wraleaeee 
fantastiewsums aresces eo llGearecad, fOr stats Ur pOces 

"The content of (or meaning contained in) a definition 
should take into account the objectives of the researeneewaaa. 


nee Whether the 


COMMG?H AnGysSclent iter Us acemom me Comecore 
"common and scientific usage" of threat can be provided 
some universally acceptable level and embodied in a defini- 
tion that accounts for this country's objectives in Pegein 
ing threat cannot be determined at this time. What is clear 
is that too many times this undertaking is poorly done mam 
accomplished at all. If the reader will turn back” [omeg- 
first and second opening paragraphs in the introduction. 
will perceive no definitions of threat by either Mr. Tiaieas 


es Rekori, Op. cit.) P. ipa 
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or Mr. Proximire. One will see a reliance on the notion of 
threat embodying some primitive understandable concept. This 
i an fact trues Butecan thistiacionmbaser 1! U- ees peneeerures 
memmderense (tonthessum ofe¢@ Seba 1i omeimoo seme oie 
notion? One would think not. 

The present methodology dictates development of wide 
Pemees or options at great expense without knowledge that 
any of these major weapon systems and national policy contin- 


é3 The lead times of many of these 


Bemiewes Will ever be used. 
systems are as long as ten years (due to the embodiment of 
wide ranging capabilities within each system for unknown 
contingencies, one would think). 

mime emphasis of Defense Department spending on the devel-— 
opment of multi-billion dollar systems has an effect on a 
@emaemetal adversary. This effect 1s unknown, but most likely 
pemesetfect does exist. The studies supporting these systems 
fier deal with it. The analysis of this effect might serve 
Geomsenelye complete development of the system once a desired 
wien, forecasted by the systems study, had taken place. 
feaemiilitary tactician would call this tactic a feint. The 
effectiveness of military feints can be measured by the 
amount of enemy men and material committed to counter them. 
This particular notion and its use in systems analysis has 


mieeae  pOocential, but again rests on a greater understanding 


e3 Hitech, C.'J.,° Déeciston—Makine for Defense (Universicy 
Peecalifornia Press, 1965), p. 75. 


a0 


of threat as this country and its potential adversaries 
perceive it. 

Teen purecse Of this general discussion has been to 
uncover some functional relationships that give insight into 
threat assessment. (The structure of the problem of threat 
assessment is discussed in Section V.) This insight™was 
intended to be accomplished by clarification, argument and 
explanation of major issues that concern the assessment of 


threat carried on today by system analysts. 


B. NATIONAL GOALS 

National goals and the values of the people of a nation 
are exceedingly difficult to define. Historically, i223 eee. 
that the task fell to officials to voice these concepts to 
the satisfaction of the masses. In the United Statesmiiag 
are elected to offices of great importance by their abiding, 
to voice what people want. 

The difficulty that an analyst encounters in his quest 
of threat assessment is the relationship between threats and 
goals. Goals are constructed from values. A single goal may 
be constructed from a single value or an infinite number 
national goal, the goal that the majority of the people of a 
nation feel should be accomplished, therefore is made Upmire 
the many values possessed by this majoricty. 

If national survival or the continuance of the cultumes 
traditions and ideology of a nation is a national goal and 


if this goal is threatened by another nation tremendous sums 
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in lives, resources and money are paid to protect this goal. 
On the other hand, if national survival is not a paramount 
national goal and a foreign power threatens the culture, 
fieacdition and ideod@dergy of a nation; many Times tne sprovece: on 
of these concepts is adopted as a result. 

One can see that values do make up goals but threats to 
previously unknown goals can motivate a nation's people to 
foeomup these threatened concepts and force their acceptance 
as national goals. 

By this reasoning national goals embody the values of a 
people, or their leaders. Threats to national goals tend to 
make nations able to define these goals more clearly or adopt 
as national goals those concepts that seem to be threatened. 

Why is this discussion presently mired in this sort of 
feeesoning? It is because if one cannot somehow relate to 
analysts what the nation's goals are, it is exceedingly dif- 
ficult for the analyst to accurately assess the threats to 
MieoeenecOals. Further insight into the problem of national 
goals finds that analysts not only need to know what the 
goals of a nation are, but to what extent they are valued in 
Getanton to each other. If this is not known and the assump- 
tion is made that they are equally valuable then misallocation 
Sieresources to accomplish national goals resultg. For example, 
if the United States valued in a similar manner national sur- 
feveal and environmental cleanup, it would spend equal money, 
time and effort on them. (This example implicitly uses 


values as the mechanism to relate resources to goals.) 


ell 


It is important that analysts find some mechanism that 
attributes values to goals (once national goals are defined) 
and the amount of threat to the most highly valued goals. 
This process will allow allocation of resources to protege 
taese goals. This mechanism will help to solve the prepilin 
if it is remembered that defining national goals shouldmpe 
the Srarving poOmmae 

Contemporary scientists inherit Tremendous ‘avers oe 
the process of making value judgments or deciding whavere 
people ought to value. If scientists concern themsel Veaewaaae 
what people actually do value, there is no conflict ais 
this can be done, it will lend tremendous insight 1Ge@iae 
creation of national goals. With these goals as a Sta@maia 
point, concentration of effort on assessing the threamuiam 
LheSemzeals = canoe accomplished: 

Whether any of the concepts in the preceding discussamn 
will be accomplished depends on future efforts to tac 
these concepts. It is safe to say that the goals we wang 
as a nation have yet to be determined. The threat CTOMuiI 
eqoyeble is elo eeiaiolsiae = eel 1a eesti Wielay te neioibie feroye Ite 

An analyst who does not recognize the infra-strucUW@mewe 
the problem of threat assessment and does not agonize Oma 
his assumptions concerning this infra-structure will Dem ae 
to think he has truly solved a problem, when in Tact Meme 
only compounded it by possible misallocation of resoureeames 
in any event, allocation of resources to personally ascribed 


goals assumed to be national goals. 


Ba 


C. MEASURES 

in. anyediscussion ofescientd Tie ne dedko De Sasa iG iaies) 1 
logic, necessarily one must discuss measurement. In systems 
analysis measurement plays an important role as it does in 
Pobbescientific activity. Yet there existe nomena om 
Hoataeemnent. to. guide pigeactd tioners us ln fact Conn o vena’ 
centers over how measurements are made and their effect on 
tmemiresults of a given study. This controversy over measure- 
ment affects acceptance of a study and therefore, implementa- 
tiomeot its recommendations. 

The controversy over measurements prompts much of this 
Meese eeation. Hor how can one measure such an ill-defined 
and complex concept as threat in such a situation? In this 
context, it was appropriate to discuss only the possible 
Seiemure Of measures of threat. 

As a starting point, the establishment of the dimension- 
ality of measurement of threat should be made. Scales (i.e., 
ordinal, cardinal, interval, nominal) for each dimension will 
determine the sort of mathematical operations that can be 
performed and to some extent the amount of information con- 
tained in each measurement of each dimension. 

Once the dimensions (areas of interest) of the concept of 
Miteear are determined, the division into Subregions of Inter- 
est of the dimensions must be determined. After the concept 
of threat is refined to the point of understanding by dimen- 
Slioning each dimension of interest one can visualize the 


interrelated concepts that characterize threat. A matrix 
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Cie wie cdimensions can be used» tor discussion. The m 
represents the number of initial characterizations of threat. 
Maemo represents the possible number of characterizationsmem 
each dimension. Now each element in this matrix can be 
another matrix of m x n and so on. For example, a potential 
enemy's threat to this country can be divided into three 
categories: economic, cultural and military. These cate= 
gorles can further be divided. For example, the cea. 
threat can be divided into several more categories Such =ae 
foreign trade, effect on world markets; etc. “The” forcma 
trade category can be further characterized by tons Of Wage 
exported, tons of goods imported, tariff barriers, anda. 
The measures of the basic elements of these last matritees 

can be relatively simple. The question is now whether these 
basic measures can be related theoretically to the original 
matrix that was decomposed. The point of this example is 
that until a generally accepted theory of decomposing threat 
into basic, measurable concepts is accomplished one Ts™emmece 
to assumptions and scenarios and other scientifically crude 
methods. (This point will be taken up later.) The intent is 


not to imply that these methods are wrong or less right than 





future scientific methods of measurement of threat. The witigens 
is to state that they are not reproducible, that is, each is 
researcher-dependent. The extent to which one man using an- 
other man's methods achieves the same result determines the 
value of the method. (This country has deeply felt the loss 


of astute political scientists and diplomats over and over 
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again when less accomplished individuals tried to interpret 
world events. This loss was felt because the method of 
these men could not be used by other men to accomplish 
similar results.) 

This discussion is not meant to imply that the quantifi- 
@Gamasen of threat lies inecounting missiles or stoens of fehap— 
pam or whatever, although the quantification may well be 
Soncsained in such an accounting. What is the intent here is 
Wememphasize that the careful documented construction of a 
theory of measurement of threat is a requirement to any study 
Paeempases its results on the quantification of threat}? What 
CO be measured and in what manner is not, and can never be 


assumed to be a simple task. 


D. RESOURCES 

Benore the advent of systems analysis and the plannane, 
programming and budgeting management tool in the Defense 
Department, the President usually informed his Defense 
Peerebaries of the amount of money intended for each depart-= 
ment. The respective departments then maximized defense with 
Beapecs to this budget ceiling. Now without arbitrary ceil- 
ieee limit the budget required for defense, the Defense 
Be@ertment attempts to support political objectives in an 


24 


optimum manner. 


24 MeNamara sy Rowe. Lien ht ommibanprowwon Politi call 


Seyecvives and Their Impact on the Budget," A Modern Design 
for Defense Decision (Industrial College of the Armed Forces, 
1966), pp. 27-29. 
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The past discussion of measures and their importance 
was motivated by the fact that as a nation we are limited in 
the resources used in national defense. Resources such as 
manpower, natural resources and mental resources (the nation's 
will to accomplish a task, educated personnel able to pera 
complex functions or cope with complex problems and situa 
tions) are limited. The manner in which they are allocated 
helps construct the fabric of a nation’s existence mn 
nation emphasizes the manufacture of war materials it cannot 
produce as many consumer goods that require the same Gygemew 
resources. “Ii this “ecountry famls or isin error inva 
assessment of threat in relation to its national goals; ene 
misallocation can be costly indeed in terms of the national 
resoimee—<. 

The need to determine the magnitude of the error in 
threat assessment points up the need for a bench mark or 
index of defense level. Otherwise, the calculation of threat 
ean be of no use in allocation. In the past, the tendon 
has been to plan to defend every possible imagined contin-— 
gency given a budget ceiling. With possible threats amma. 
from future Viet Nams to sophisticated submarine-launched— 
multiple-warhead missiles, the defense against this total 
spectrum is too expensive without an index of defense Wea me 
Say iia eis Oo hate lt One eRe SOlui-ceae 

The nation is faced with the problems confronting ail 
modern, highly advanced industrial states such as environmen- 


tal pollution, urban transportation, urban renewal) popmimayica 
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control and education. The defense of the nation must 
compete with these other areas that require the same re- 
sources. Could one reduce the spectrum of actual threats 

to this nation one could increase the spectrum of internal 
problem areas attacked with the resources that were destined 
for defense. At this time, no way exists to narrow the 
Sseeectrum of threats perceived by this country. Indeed, no 
method exists to compute the cost in resources to this nation 
in defense against a single weapons system arrayed against it. 
Could this cost in resources be computed, it might prove to 
memweo high. The nation might reconsider defending against 
that particular weapons system, or at least, the nation's 
defense planners might consider if the system were ever going 
to actually be used against this nation. In any case, an 
open-ended budgeting process~> based on inexact allocation 
feeds Should not be tolerated in an environment containing 


limited resources. 


Pee Om OCLOLON—MAKING AND POLICY DETERMINATION 
Alain Enthoven stated: 


Do judgment and experience have no place in this 
approach to the choice of weapon systems and strategy 
eimemcestpn Of the defense program? “Quite the contrary. 
The suggestion that the issue is judgment versus 
computers is a red herring. Ultimately all policies 
are made and all weapon systems are chosen on the basis 
of judgments. There is no other way and there never 
Will be. The question is whether those judgments have 
tO be made in the fog of inadequate and inaccurate data, 


62 thid. 
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unclear and undefined issues, and a welter of 

Pomp l1 cling personal Opinions, or whether they can 

be made on the basis of adequate, reliable informa- 

Muon vole Vale experience, and clearly drawn Issues: 

The point is to render unto computers the things that 

are computers’ and to judgment the things that are 

mudgment's. dane the vend, there is no questvon that 

analysis is but an aid to judgment and that, as in the 
case of God and Caesar, judgment is supreme.26 
One must submit that the decision to "render unto computers 
the things that are computers'" is as important a decision- 
making activity as the decisions about the selectionm@em 
strategies and weapons systems that are based on OUUDpUGMi ron 
computers. 

One may define the analysts' contribution in the defemse 
establishment as improving the perspective of decision-makers 
and increasing their ability to react to changes in ths 
environment in which they function. If analysts are UGheaay 
of as decision-makers setting policies concerning their ap- 
proach to scientific activity, the perspective they present 
to decision-makers is biased by the analysts' research deci- 
sions. It is accepted that the decision made by an individuals 
who has been assisted by analysis is better in some sense than 
the decision made about the same situation without the benefit 
of analysis. It is probably clear that the method by which 
one acquires his information determines its value. 


Acceptance of the criterion of having the maximum amount 


of information about a problem or situation leads clears 


26 Enthoven, A. C., "Choosing Strategies and Selecting 
Weapon Systems," A Modern Design for Defense Decision (The 


Industrial College of the Armed Forces, 1966), pp. 143-144. 
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naturally select decisions made with more information as 
better. Modern day Defense Department policy-makers depend 
on quality information. An efficiens sertins ange tive rmins 
et-information into usefull form is required. ~Whis 1s where 
syovems analysts use Cheir seientifie approach and mathemat— 
fea! tools and their own decision processes. gihus, detense 
itimorcement has decided that some of the most valuable informea— 
Cion is that produced by systems analysis. Furthermore, this 
decision was prompted because of the method whereby analysts 
fo about their analysis. 

Hitaweis tiles pOint? Ties this se sa method that alles 
tos practitioners to make faulty decisions in its practice 
is not valuable. <A study based on a threat assessment that 
isetaulty deteriorates the quality of the decision or policy 


based on the study. 


Sy 


V. NATURE OF THE PROBLEM 


A. GENERAL 

"One should know one's enemies, their alliances, their 
resources and the nature of their country in order to pillag 
a campaign."*! So said Frederick the Great in 1747. The 
problem of assessing the threat of one's enemies certainly 
isn't new. In Frederick's time armies were formed to be 
used. Once one discovered that one's enemy had an army ae 
could be sure that war would follow. Only the time and pace 
Ol Thee times leteron Ol “Werlare Meccdea colbimallon, 

Today threat assessment is complicated by the fact that 
most countries have standing armed forces. Many of these 
forces are equipped with weapons of awesome destructive power 
and have the ability to employ them within minutes. The cost 
of defense is related to how much threat one's enemies present 
and how much threat is desired to present to them. 

In this age possessing weapons does not imply their use. 
The decision to use military power might then be construed to 
be threat. But if military power has no ability to prevent 
one from accomplishing one's goals it may not be threatens 

Dissertations concerning what threat is and 1S NOpmamge 
usually constructs of the writer's imagination. Argumemee 


such as: 


eli Frederick the Great, Instructions for His Generals, 


trans. BGen R. R. Phillips (Stackpole Co., 1960), p. Oy. 
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Let us realize that the threat itself represents 

the culmination of a decision analysts aby view Opponent, = 

From an innumerable set of variables, certain values 

have been extracted and collated in the specific 

threat. The threat is then the opponent's value repre- 

sentation of the interrelated decision processes of the 

threatened and the threatener.2 
are clever and seemingly correct. What is never clear in 
these arguments is how one arrives at such exact definitions 
and explanations of threat. If there in fact exists no method 
Sige than a seli-survey of what a particular observer [eels 
about how threat should be defined, systems analysts must be 
fuemevoO Value these feelings in order to base analyses on 
Piet AL present the ability to value is not operational in 
the sense that the valuing process is reproducible. 

The inputs to the Defense Department can be characterized 
as coming from various intelligence agencies, the State De- 
partment, the National Security Council, the President and 
Congress. The outputs from the Defense Department can be 
Garled national defense and characterized by programs, pol- 
1e¢ies and plans supported by the defense budget. The problem 
of tracing any one input throughout the entire defense estab- 
lishment and then noting its effect on the various outputs 
is staggering. (It may be that once this is accomplished, 
the action that the defense establishment takes on its various 
inputs would constitute the starting point whereby scientific 


28 Thompson, W. F., The Treatment of Subjective Factors 


in Threat Analysis (unpublished Master's thesis, The United 
States Naval Postgraduate School, Monterey, 1961), p. 29. 
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momar Lhreap assessment could begin. Or ideally, these 
actions may be suificient and the problem of assessing thréan 
has in fact been accomplished.) Alain Enthoven described why 
the process of tracing any single input would be difficult im 
1962: 


To the extent that major national security po lim 
problems .are quantitative in character, calculaniog. 
are relevant. Of course, there are many things umae 
Simply canmot be calculated; for example, the rei 
bility of an ally, or the psychological and polivti@m 
consequences of a military operation. And these mene 
quantitatave factors may dominate the problem. |) Bue 
there are also many things that cannot be done i147 aa 
tiniely=orwbased GCniitvewy Cneeweorience. jMiiwitaed 
ana experience unaided by cabeulations will neve vesm 
us how many ICBM's are needed to destroy a target 
system, nor will they tell us how many C-141's are 
required Goswmeovemawei Vision. KRewemost of these 
questions, a mix of cCaleulatioens, intuition, aud 
experience is required. One of the biggest chal@eiee 
facing us today is how to find ways of blending there 
factors better in those areas in which unaided calem@ne 
tion is weakest.c9 


This system description is crude but of sufficient deUCaisiims 
adequately describe what goes on today in the Defense Depart-— 
ment concerning the assessment of threat. Because no Tia 
exists to value these assessments scientifically, the error 
involved in this process is unknown. No presently reproduc— 
ible method of threat assessment exists, what does e€xiStyaa- 
ever changing methods used without benefit of a theonryaew 
even crude operational theorems. The methods used are jgne 


preference of individual decision-makers and analysts. 


zo Enthoven, A. C., "Operations Research at the Navaema 
Policy Level," A Modern Design for Defense Decision (The 


Industrial College of the Armed Forces, 1966), p. 158. 
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Since analysts are faced with developmental problems 
when dealing with assessment of threat it seems plausible 
that a thorough knowledge of the history of epistemology and 
whe theory of knowledge would be paictmeiericieeintene ee IT 
ieamou SO in general, Pretessaonal philesepnercwon tic wericr 
hand, possess the knowledge of these subjects but know little 


30 Consequently, the attempts at 


of present day science. 
construction of theories and/or methods by analysts often 
ieee tall to include the results of past methodological 


sal 


Tmguiries. Mois lack of rigor confounds the problem of 
assessing threat with that of theory construction. Could 
this breach be narrowed by both philosophers and analysts 
much progress could be made in just the establishment of a 
method of communications between these two diverse professions. 
The various inputs that the Defense Department received 
when characterized as a system present a problem to analysts. 
For example, if an analyst receives an assessment of the 
Middle Hast situation from the State Department couched in 
their own unique jargon, it would be extremely difficult for 
the analyst to re-examine this assessment, select and value 
the pertinent variables relating to his analysis without 
Specific knowledge of how the appraisal was made. Implicitly, 
the State Department values its information. This valuation 


is not reproducible in a scientific sense either. Faced with 
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this dilemma the analyst usually uses his own "mix of 
ColicitatTons yeantudtiongeand experience. as required. °° 
Whether this "mix" has a debilitory effect on the original 
SvatesDepartmentwassessment»sis unknowneeeim light. ofa 
Esample, the Necaerer a mevhod™ or valuationvet input seams 
defense analysts is confounded with the problem of threat 
assessment by these same analysts. Obviously, much of threat 
evaluation lies in workinf@ with present inputs to Detewee 
Department channels (possibly all threat may be assessed by 
using present inputs) but until a systems analyst truly under- 
stands what an Under-Consul in Haifa meant by “awesome ability 


to conduct war," for example, one must assume the analyst 


will impart his own particular interpretation to this (a -] 


B. THE LACK OF A GENERAL THEORY 


The problem of choosing strategies and weapon 
systems is a unique problem requiring a method of 
its own. it is obviously not Physics or Engineeritas 
or Mathematics or Psychology or Diplomacy or Economies 
Nemes 126 entirely asproblem in military operataeme 
though it involves elements of all of the above. 
Because it involves a synthesis of the above-mentioned 
disciplines and others, it requires the cooperati Gimmie 
experts in all of these professions and many othewes 
It is a not infrequent error, made by civilians and 
military alike, to identify defense planning uniquely 
With one of the above professions or disciplines 


32 Enthoven, A. C., "Operations Research at the National 
Policy Level," A Modern Design for Defense Decision (The 


Industrial College of the Armed Forces, 1966), p. 158. 


33 Enthoven, A. C.;, "Choosing Strategies and Selec 
Weapon Systems," A Modern Design for Defense Decision (The 


Industrial College of the Armed Forces, 1966), p. 138. 
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It is not easy to tell someone wiow (oO Carm@ out 

a systems analysis. We lack an adequate theory to 

guide us. This must be expected, for systems 

analysis is a fairly new diselp | ime tases eecnqe ay 

teaches us that good theory usually comes late in 

the development of any field and after many false 

starts. Where the attention of systems analysis 

has turned to methods, it has focused mainly on 

the development of mathematical techniques for 

handling certain specialized preblems, common in 

bie Practice OhwOperavromse 1 esecaren= talented 

Building a basic theomy, for the Greatment of the 

broad questions typical in defense planning 

The more important philosophical problems 

euch as OCCUr Il provlidmie dsourance Chat. the model 

is meaningful, in devising schemes to compensate for 

Macercainty. or InN -enoosing appropriate Dy eee ow 

effectiveness, still remain troublesome. 

The result of the installation of systems analysis at the 
National Policy Level in the early sixties has been to assume 
in many cases that the application of methods used by indi- 
vidual analysts were valid because of the operational nature 
of the Defense Department. Systems analysis as a discipline 
in relation to the development of an adequate theory is like 
a leaky boat at sea. The boat needs dry docking and re- 
farerking but it still needs to carry out its mission. Pump- 
ing and underway repair go on at sea without a course change 
to a repair facility. Systems analysis is in use today. It 
produces answers that are in need of a theoretical back-up. 
The assessment of threat is an important step in this theory 
development because once a threat estimate is made the re- 
miem@aer of the analysis is built upon this Geundation. A 
contention of this paper is that a recursive theory—-building 
process should start with the assessment of threat. Once 
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this assessment problem has been resolved the construction 


of an adequate systems analysis theory might feallow. 


C. THE ROLE DISORIENTATION OF ANALYSTS 

The question of what discipline or what group should 
properly address the problem of threat assessment is moot. 
This deprivation of practical significance of this question 
comes because the construction of a method should precede 
the assignment of the method to a discipline. But yet the 
construction of a method to accomplish something is biased 
from what perspective the construction takes place. 

Political scientists may already claim the abi lit yee. 
assess threat yet their method cannot be used by systems 
analysts not knowledgeable of their discipline. Methods con- 
structed by a particular discipline usually are constructed 
for use by members of the peculiar discipline. (At least 
historically this has been the case. A case in PpOlnt a. 


mathematics. Mathematical techniques that were obscure five 





hundred years ago have recently found use in other disciplines: 

The disciplines involved usually had gained eweueh mathematical | 

rigor over the years for proper communication with mathematics.) 
Since systems analysis as a discipline is relatively new 

and has developed from other considerably advanced disci- 

plines (Mathematics, Mathematical Beonomics, Engineering and 

Physics, to name a few) the channels of communication to less 

advanced, less rigorous disciplines in the behavioral-social- 

political complex of disciplines are few. This causes the 


typical systems analyst to endeavor to make these disciplines 
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fit into his particular schemata of analysis. Oftentimes 
this results in misstatements about the exceedingly complex 
structures which make up the phenomena with which these 
social sciences deal. With these oversimplified problem 
statements as a foundation systems analysts build up their 
own exceedingly complex scientific analysis until one must 
question the value of the analysis. [See Green, Ref. 7]. 

The crux of the problem here is what this paper terms 
Geme Gdisorientations —Because the analyst is asked by 
decision-makers to deal with problems that in the past were 
nominally dealt with by social disciplines, the analyst at- 
tempus to answer these questions. The result is oftentimes 
catastrophic. Not only does the analyst embroil himself in 
areas of other disciplines where he may not be well versed, 
but he may present such well ordered, logical and complete 
arguments considering his assumptions that the decision-maker 
temeerced to arrive at the analystes conclusion also. In 
Begem Words, by his clean-breasyt technique sor dealing with 
normally complex phenomena the analyst assumes the role of 
the decision-maker or policy-maker. (Scenarios play an 
important part in these predictive arguments and are probably 
the worst methods used by analysts in light of over- 
Simplification.) 

Measurement plays am important part® also in the further- 
ance of role disorientation. The evolvement of Systems 
Analysis included inputs from Industrial Engineering, Opera- 


tions Research, Economics and Physics among others. If one 


q7 


accepts the observation in relation to measurement that 
physical scientists at one end of the spectrum are concerned 
with problems of measurement arising from accepted models, 
and if one accepts also that social scientists at the other 
end are concerned with problems of measurement arising from 


oe 


proposed empirical studies it follows that systems anal- 
ysts can be concerned with the complete spectrum. With He 
general theory of measurement to guide all sciemtiitic erga 
it is plausible that the measurement schemes used by the 
physical scientists and behavioral scientists would be of 
interest to systems analysts. The import of the discussion 
is that analysts construct their own methods of measurement 
without consulting other theorists with similar problémes 

The lack of effort that the discipline of systems "aia 
ysis puts forth in the assessment of threat may be duce 
its members! basic acceptance that the measurement of threat 
is impossible in a manner suitable for analytic studies. 
Questions of whether the discipline is organized to carefully 
construct an accurate and relatively precise method of threat 
measurement are answered in the negative. This seems To 
allow oversimplification of the complex phenomena of threat. 
It is assumed that the structure or its functional reais 
eannot be outlined. This is again role disorientation 


because the organization of systems analysis is based on the 


35 Churchman, C. W. and Ratoosh, P. (ed.), Measurement: 
Definivions and Theories (john Wiley & Sons, Inc., 195Gpm 
eel: | 
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claim of considering a problem ian relarvron to oem rier — 
acting areas considering spillovers and the construction of 
theoretical bases to adequately describe or predict the 
problem solution. One must submit that the organization of 
the discipline is eminently suitable for going about threat 
assessment, but it should not go about this task in relation 
to a single study. The fundamental effort needs to be in 
construction of a general method such that individuals can 
then tailor the results of the application of the basic 
theory to his own needs. Ideally, one should practice 
Systems analysis by applying the methods of other disciplines 
instead of constructing new methods of analysis. Certainly, 
one practices without tampering with the theories on which 
the methods are based. Yet as previously discussed over- 
Simplification of theoretical bases results when systems 
analysts attempt reinterpretation of other disciplines'! 


methods of dealing with threat. 


D. VALUE JUDGMENTS 
National Defense Policy is generated by the interaction 
of value judgments and the costs of military forces and 


36 


weapons systems. That these judgments are recogniZed as 
part of the nature of systems analysis is not clear. Pref- 
ememce for standing back and pointing out to decision- 


makers the results of their analysis is the image of systems 


36 Enthoven, A. C., "Operations Research at the National 
Policy Level," A Modern Design for Defense Decision (Indus- 


trial College of the Armed Forces, 1966), pp. 155-156. 
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analysts; when in fact, the analysts implicitly value 
variables in models by singling them out of problem situa- 
tionses Thitsmsortecteyvalwatron=bysanalysts during threay 
analyses may cause an opponent to be much more threatened 
than he actually is or vice versa. What is pointed out here 
is the importance of determining the actual threat. In the 
interim, explanation as to how one values must be included 
in analyses with other assumptions. Otherwise decision- 
makers will assume a senepeNAriien: analyst's value system to be 
valid when actually it may be fallacious or incapable of 
selecting an accurate estimation of the situation. In this 
case it must be the decision-maker's prerogative to set the 
level of threateforspartileudeer analyses. 

Analysts presently do not involve themselves with spe- 
cifile statements about vakue and its relation to threagaame, 
is exceedingly difficult to formulate National Policy with- 
out counting arms, men, systems and dollars, i.e., using the 


>i 


relevant numbers but it is senseless to manipulate these 
numbers analytically without proper qualifications of ayia 
they need manipulation. Until someone qualifies why one 
should endeavor to undertake an analysis, the finished anal- 
ysis can never be optimal in any sense. For a study to be 


optimal one must have something to optimize. In this paper, 


the something can be termed "optimizing how the defense 


ese. 
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establishment handles the National Security after finding 
what level of threat it faces to secure against." Present 
Studies seem to optimize handling jor iavi onic meee 
emelovelof threate, If threateis cont  nmeus er nieS senile Ss Sa 
Miminicy Of possible eptimal solutions. 

Emphasis on what valuations took place in a study imply 
memeonsideration of variables not included in the study. 
This sort of method implicitly places zero value on the pos- 
sible variables that were not included. In the ethereal 
world of threat the setting down of the valuations one makes 
subconsciously is impossible. The exhaustive listing of the 
femeaciOus decision process is not that difficult. The 
Poel listing is less arduous. <A study should attemptgto 
take up this task to prevent basing a scientific effort on an 


unspecified foundation. 


BR. THE TRANSLATION AND INTERPRETATION PROBLEM 

Much of this paper has been concerned with the lack of 
a sufficient method to quantify threat. There exists methods 
that attempt the assessment of threat. (See Section VI) 
They suffer from a common factor. The methods do not embody 
a complete-enough translation of the concept of threat. 

The people of the United States deal with a concept of 
Wmmeeat that is different than the one with which their Gov- 
ernment labors. The problem that rears-up is that of anal- 
fecal translation and interpretation of individual concepts 
Bereuse in an anmalytical context. For if a study does nor 


conceptualize threat in a manner that accounts for the 
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Vretews COneepcs that these individuals characterize one 
G7rborevisualize the optimum pRovision ofthe common. dewmerice 
Seats “ulese Lelewrnreats™ 

The natural question fedlowing is, how dees one koowerae: 
these individuals really know what the threat is? Themreijamt 
is tChatethis source smpplabesethe swdcet that Supports tie 
defense effort. The job of defense as this paper sets forth 
1s either measure the shreet or quant ii yewhat is Telia 
those individuals supporting the defense estabiaishmenie 

To make the translation problem clearer an example is 
wsed. Prior tte the present abilities to plot the coumseemaa 
tropical storms or hurricanes the best defense against them 
Was to cawse whede @ections of the coast thought to be threat-_ 
ened Go dig in, board up, and so forth. If the anxiepa 
shovels, ulcer pills and other sundry items used, cowlGmiiave 
been costed, one feels that the amount would have beeniiaaee 
mendous. This cost stilled the fears (or perceived threats) 
of the individuals involved. Once the actual threat CauaR 
calculated by weather satellites and aircraft the cos@aian 
hopefwilly cut. Presently, defense analysts possess Nowe 
ods to quantify threat and they endeavor to calm thelr own 
fears, not the fears of the threatened people of the United 
pilawes. 

This problem is not just inherent in the relationship 
between the taxpayers of the Nation and analysts. More 
importantly to the analyst it exists between himseli amemiea. 


decision-maker he serves. Possessing no adequate method to 
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handle threat, the analyst usually turns toward what his 
decision-maker perceives. Then he must translate this per- 
ception into understandable terms to proceed with the study. 
The question again arises as to the validity of the decision- 
maker's perception of threat. 

This translation problem is a deceptively simple concept 
but exceedingly difficult to resolve. To resolve this prob- 
lem can be no more difficult than the resolution of the 
threat assessment problem, and intuitively much less fruit- 
ful. The translation problem disappears once threat assess- 


ment is accomplished. 


F., INTERFACE PROBLEM 

One-or tne maxims of the Conduct of systems analysis is 
the extreme importance of the analyst interfacing with his 
decision-maker. This interface action cannot be properly 
accomplished with a staff or a directive. Yet one can dare- 
say that singling out ten important decision-makers at the 
level of National Defense, that fe ime level of the National 
Poemeetty Vouncil, that these men never personally espouse 
nietr 10deas of perceived threat Co analysts in the Department 
of Defense. Yet analysts using policy directives must trans- 
late this guidance without benefit of a give-and-take dis- 
cussion. One may argue that this interface is not practical 
at this level, that these men are too busy. The answer is 
then, restate how systems analysts must operate at this level. 
The decision-maker acting on a study today is not allowed the 


knowledge that the study is a translation, a personal one 


oy: 


Peculiar toethe systems analyst that constructed it, and the 
study cannot reflect the personal perspectives of the 
decision-maker. 

The development of a method of practical interfacing of 
analysts and appropriate decision-makers is paramount to the 
solution of proper threat assessment. It cannot be perceived 
that a method of quantifying threat can be accomplished with- 


out intimate access to the decision process. 


G6 CU SCENNARLOD. © PRE ASO UME PON Or TH Rea 
The classic vehicle for systems studies is the scenario. 


It appears that the phrase, "Now this is a scenario 
.,' can be found to be variously applied to 
An outline of a sequence of hypothetical 
events; 
A record of the actions and counteractions 
taken by parties to a compilmet ; 
A plan of actions to be taken during a 
projected™@exercise or maneuver; 
The estimate of the situation by Commander 
"X" at time "Y" in a war or war game; 
A specific set of parametric values selected 
for aVeltVeuerun Of sence comeure 

How, then, can we proceed to talk about "scenarios" 
without excluding someone's notion of what scenarios 
really are? 

If we dwell for a moment on these various notions, 
we do find a common thread. They all refer to des= 
criptions of the conditions under which the sysweme 
they are analyzing, designing, or operating are assumed 
to be performing. The system may be a weapon, it may 
be a component of a weapon, it may be a vast complex of 
weapons and support facilities (such as NORAD), it may 
be an organization (such as the National Military 
Command and Control System), it may even be the entire 
national security establishment. Whatever the scope 
and properties of the specific system, a scenario-im 
systems analysis-can be defined as a statement of 
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assumptions about the operating environment of the 
particular system we are analyzing. 3 


Creation of a scenario (for general nuclear war) 
is one of the most difficult aspects of systems anal- 
ysis, and calls for great imaginavion em = cien var. oF 
those concerned with predicting how a system may be 
used at some future time. The analyst obtains informa- 
tion regarding possible scenarios by discussing such 
possibilities with different decision-makers and 
operational personnel, each of whom may have »,onesor 
more environmental situations in mind. Thus, there 
Tie probably bewme Uns orm acreemenp som any sere 
scenario, and the analyst may be forced to deal with 
a wide range of possibilities. Incidentally, this is 
a common problem which the analyst also must face in 
pathering data which involves the intuitive judgment 
of others. . . . the analyst copes with these uncer- 
tainties, particularly in the early phases of the 
analysis, by making explicit all data and information 
he uncovers including contradictory opinions.39 
(Parentheses and underscore mine) 


The scenario drives the analysis effort. The scenario 
is a method whereby analysts detour around the problem of 
threat measurement. Precise statements using "great imagi- 
nation" neatly sidestep the problem. If a decision-maker did 
not agree with a particular scenario the study was a failure. 
More importantly, if the scenario did not parallel reality the 
Seuaqy was a failure. 

A scenario is a highly complex series of assumptions 
meme Lhe future with no theory of scenario construction with 


which to guide its writer. Scenarios are assumed levels of 


2° ER, SMe Sees SUSE Sina, 2 Sas eeee 
Analysis and Policy Planning (American Elsevier Publishing 


eeeines, 1960): pow 299-300. 


37 Rudwick, op. cit., p. 102. 
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threat. Analysts allow optimum solutions to be generated 

in relation to these levels. For every level of threat (or 

scenario) one has an optimum solution. 
PeeschUscyalomObeticmart: Considerations dictate Gm. mam 

of scenarios. These imaginative schemata of the future could 

be digearded with théewadvent of a methodology for threag 


assessment. 


H. TEMPORAL CONSIDERATIONS 

The estimation of threat concerns one with an area jaa 
has fascinated man in the past and still does today. ‘Tuam 
the prediction of future reality. There are many predictive 
problems that have been solved at least to the extent that 
mankind can derive useful information from the answers. 
Tides come in and out on schedule and the moon moves as "gna. 
dicted allowing the United States to place men on it. he 
baste structures of myriad predictive phenomena are wou 
understood today. Reality can be defined as the total envi- 
ronment, perceived or not, of man. (Because a man does not 
know a nail awaits his tire on the road ahead, does not dis- 
allow the man from having to cope with the flat tire.) 
Future reality is this same environment after a passage of 
time. Analysts are not concerned with the effectiveneseme 
weapons systems or policy decision in post hoc operational 
analysis. They are concerned with future effectiveness of a 
SYVSCteM Or poll Cynon lus wien ice lent 

Presently, a five year lead times for system development 


are common. Polley decisions depend on capabilities om@igma 
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and anticipated. Systems whose development start today may 
influence policy five years hence. Policies today may mod- 
ify systems tomorrow. These interactions plus present and 
future threats, dictate the nature of the problem with which 
analysts must work. 

ihesabi litywetio,oquamitset yee breat. tiodavawi tient sdexc lie mmenc 
of methods to push these quantifications into the future will 
invalidate studies that are not related to future time peri- 
eds. A particular analysis that is ebsolutely correct adm one 
Giemosneriod may be entirely wrong in another. 

The ability of individuals to objectively predict future 
threats without confounding these future predictions with 
present reality is exemplified in history. The generals at 
Verdun misinterpreted, to the tune of a million casualties, 
the deadliness of barbed wire obstacles covered by rapid- 
firing machine guns, the battleship admirals never dreamed 
emeoecoraft sinking capital ships, and the French at Dien 
Bien Phu knew that the Viet Mihn could not employ artillery 
on a mountain side. History suggests that a temporal thresh- 
Old exists with regard to threats, weapons systems and 
policies. The temporal thresholds for threat predictions, 
major policies and weapons systems effectiveness has not been 


investigated. 


i eNCERTAINTY 
The ability to assess threat can be valued by examining 
what difference a potential ability to accurately assess 


threat would make in the defense establishment. If one could 


Dit 


accurately assess threat it seems plausible that systems 
could be built in a more specialized manner rather than with 
multiple capabilities. Policy pronouncements could take on 
special meaning instead of being couched in phrasing that 

is very general and difficult to interpret. The potemvaam 
savings in time, effort and resources by precise threat 
assessment should be substantial. Presently, by necessity, 
the Defense Department must pronounce general policies, con- 
struct far-ranging programs and develop systems with multiple 
capabilities to counter vaguely perceived complex threats. 


This status quo results in cost in resources. 


J. DEPENDENCY ASPECTS OF UNCERTAINTY ASSOCIATED WITH THREAT 

The uncertainty associated with threat can be dependent 
on several aspects. Two of these aspects can be termed the 
knowledge or facts that are presently known and the risk of 
delaying to obtain more information. 

Suppose for example, one could associate an uncertainty 
range to the threat imputed to a United States policymee 
Assume also that the knowledge one has concerning policy A 
has an uncertainty range associated with it. It is plausible 
to assume that there exists an uncertainty range concerning 
the risk of delay to find out more knowledge about policy A. 
suppose further that policies B, C, D, and EB also somemem 
affect policy A. Policies B, C, D and E may be poltcte la 
the United States, its allies, its enemies or a mix of all 
three. Suppose also that there is a range of uncertainty 


associated with the knowledge one has about B, C, D and E 
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and the risk of delay to find oul ners = aiewic dt emavo Ue nite sc 
policies. One could go on about weapons systems both 
Mmrendly and enemy that atfect™ policy We amdsdéser 1 bem 
ranges of uncertainties that affect the knowledge and the 
risk of delay in acquiring knowledge of these weapons sys- 
mems. It will be assumed here that weapons Systems 2 and 
@eeomehow affect policy AS It=suffices to say that the 
Witeertainty range of the threat associated with policy fis 
dependent on the knowledges, risks and uncertainty ranges of 
mime mnowledges and risks of not only policy A, but policies 
Pe co, 2 and E and weapons systems A, Y and 2. 

It seems from the past example that a threat uncertainty 
memese associated with a4 particular type conception is pos-— 
sSibly dependent on a whole host of other uncertainty ranges. 
In the simple discussion above only two aspects of uncertainty 
associated with policy A were assumed (knowledge and risk of 
delay in acquiring knowledge). There were only two different 
dimensions (policies and weapons systems) that were assumed 
Memartect policy A through these aspects. The example gives 
one sixteen different uncertainty ranges affecting the threat 
Uieortainty range associated with policy A. 

Given one is concerned with the threat uncertainty range 
mesoe1ared with a concept and that there are m aspects (i.e., 
knowledge and risk) to the uncertainty affecting the concept 
and n dimensions (i.e., five policies and three weapons sys- 
tems) of these aspects one can consider Mg iC Siu Gain 
maaees aitecting the concepou'’s uncertainty range. 
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The dependency aspect of uncertainties probably could 
Mi aes NeMGeUewUOLenaaal seoitoctiwonareducingscosts iawmee 
sources. For example, if one arrives at the conclusion that 
threat uncertainty ranges could be constructed (as previously 
discussed) these ranges should probably be related to units 
of cost. tembe useful. 

If policeyeA's threateuncertainty range (in cost, uma 
depends on mn other threat uncertainty ranges (in cost iumiiee 
it seems that a narrowing of these ranges affecting polameme 
would reduce the range of uncertainty associated with pomiie, 
A, thereby reducang costs eelieonesreduced.al liarangecuime 
points, it seems plausible that the threat uncertainty range 
of policy A would either be reduced to a single point §@imgame 
its minimum range and therefore its minimum cost. 

It is clear that uncertainty costs. At this time [eiseea. 
not clear how much it costs because the implied functional 
relationships previously discussed have not been discovered 


(although most analysts suspect their existence). 


K. FIXED UNCERTAINTIES-SCENARIOS 

A scenario (see footnote 38) as traditionally used by 
systems analysts implicitly fixes threat uncertainty ranges. 
That is (reference to the example of Section J. above) given 
mn threat uncertainty ranges affecting a concept and the 
concept's associated uncertainty of threat are characterized 
utilizing a scenario, one must necessarily Tix the m ia 
certainty ranges affecting the concept one is interested in 


bAVEeSt hoards. 
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A scenario has the advantage of allowing analysts to 
handle threat. For the purposes of this paper the use of 
scenarios is disregarded due to their inability to handle the 
dependency aspects of uncertainty ranges associated with 
threat. Scenarios allow these variables‘ values to be se- 
ieeved in a manner that places no confidence in them other 
than the confidence one has in the analyst who makes the 
assumptions. In other words, whatever the scope and prop- 
erties of a particular system or policy, a scenario-in 
systems analysis-can be defined as a statement of assumptions 
about the operating environment of the system or 50117 

meso cenario, while being a useful first approximation, 
aepemaings on the imagination of the scenario creator, has no 
method whereby confidence levels or probabilistic statements 
can be associated to it in a scientific manner. If one agrees 
peo likes a particular scenario one goes along with’ the 
analysis based on the scenario. If one does not agree with 
tie state of the world as perceived by the scenario writer, 


Che study is invalid. 


L. TIME VARIABLE SCENARIOS 

peme scenarios Utilize what economists call state para-— 
femers. That is, once @ particular range of uncertainty is 
selected and optimum vrocedures conducted in analysis, the 


investigator then varies the range of uncertainty arbitrarily. 


40 See footnote 38. 
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The parameterization of state variables (uncertainty ranges 
associated with threat) assumes a particular relationship 
Dbenwecn ea thewunecwiointyeranges of the variablessthatoaiieme 
Cheval Geile sc hoape parame ler. 

When analysts endeavor to make scenarios time-dependent 
by variation ofsuncertainty ranges of threatythey makenume 
known assumptions about the variables on which these peane-- 
depen 

Further and deeper dissection of the nature of threat and 
the ranges of uncertainty one isvable to associate with 
threat needs to be accomplishedze At presentethe pmobD igi 
uncertainty cannot be handled over time because scientaiaiew 
yet have not determined how the functionals discussed in 
Section J. should be formulated (if they exist at all). One 
is now able to complete a systems study given a speci iam 
threat (i.e., a scenario). But once threats have Un CE Rea 
ranges associated with them, multiple optima can be associated 
with the ranges. These multiple optima dictate large 1a 
purpose systems and general, all encompassing, policy formu= 


lations which cost in resources. 


M. RECOGNITION OF UNCERTAINTIES. ASSOCLATED WITH THRE 
Rudwick tells the reader in his book: 


Analyzing competitive uncertainties. Here the 
key question to be addressed is, "What are the various 
strategies and tactics that the competitor (enemy) can 
employ, at what strength, and what impact will these 
have upon the effectiveness of each of the system 
alternatives being analyzed?" Perhaps the most impor- 
tant aspect of dealing with competitive uncertainty is 
recognizing that it 1S an important problem. This@ma 
seem obvious, but many systems analyses and systems 
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planning efforts are detueient bec ase ise eee reli 
that the competitor will acu am oy omer aes Umer aye 


41 
ime recognition problem associated sw pimp mea Ue Sty cmneeabe 
is fundamentally more complex than Rudwick lets on and cannot 
be simply handled by "recognizing that it is an important 
problem." 42 

The recognition problem is not only comcernmedewith whar 
an enemy can and will do with his various assets; more fun-— 
Memental and important, 1t is also cGencerned with the ability 
TO continue to recognize the change in an enemy's threat 
attitude toward us once we as a nation attempt to counter or 
neutralize an enemy threat. 

This ability is not accomplished as Rudwick states by 
PeemmpeloOn. AS this paper points out Chis ability cannow be 
geeemolished by scientific method at present. The social 
eemonces make much of their ability to observe and predict, 
but until their results can be stated in a meaningful manner, 
Meee ovOOd by system analysts, the recognition of changing 


nS 


threats remains "an important problem." 


N. PROBABILITY AS AN ADEQUATE CALCULUS OF UNCERTAINTY 
ASSOCIATED WITH THREAT 


Today there exists two theories of probability. The 


first and most widely used is the probability that is found 


4} 
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Moet erie ory.  lhewsecond can be said to be constructed from 
Msovehnollony or social Sone oe ae This paper terms the 
former theory mathematical or set-theoretic probability. The 
latter theory is called subjective or qualitative probability. 
Mathematical prebability or set-theoretic probabi am 
depends on the ordering of some reference class into classes. 
Together with vhe theory of random numbers mathemaume 
probability provides a method to measure probabilities im 
a standard Sine 2 
Subjective probability depends on the qualitative judg— 
ments of men. That is, probabilities between zero and one 
are solicited from men through some method to determine prea 
abilities associated with interesting phenomena. (Usually 
those phenomena that cannot be logically related to a set- 
theoretic probability measure. ) 
he “clear need for a probability measurement  4semem 
contested here, although the nature of threat is difiteumy 
to determine when related to the probabilities discussed. 
The nature of the problem of threat assessment bears out this 
observation. Analysts attempt to cope with threats that may 
be of a set-theoretic nature in a general historical json. 
but not exactly. Some threats may seem unique (that is not 


of a class of threats) but can in some manner be related to 


i 


It is not the intent here to discuss probability 
theory for those readers uninitiated with respect to the 
caleubus of probabil ies,. 


2 Catizelimans Op. cit., p. 30: 
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mathematical probability measures and noe Lie completely in 
Che realm of subjective probabilities. 

If one attempts to associate the statement "there is a 
mrobabillity of War Of ~5 Ge eae probaol lily MNoaoUrcy Wiiamen 
measure does one choose? Is the .5 from mathematical proba- 
bierity worth or valued the same as “> irom a subjective 
probability measure? Can one class anticipated war into the 
efass of past wars? These questions are the prelude to a 
most important question. Are present probability measures 
eeauate calculi to use in threat assessment? Obviously, the 
probability associated with the failure of the Bay of Pigs 
Invasion is not the same probability associated with the 
failure of a missile launch as probabilities are theorized 
today. Yet the probabilities that one associates with these 
two diverse events SOT LG must be used in the assessment of 
ere ats. 

Present analytic techniques weigh subjective and mathe- 
Meci@al probabilistic notions equally. This equal weight 
memeerlcainly not bound up in scientific theory. Unless 
serious effort is attempted concerning the most feasible 
method to use these two diversely developed probability meas- 
ures, studies using both measures surely have no meaning. 

One must concern himself with whether mathematical prob- 
ability can ever convey meaning in decision-making problems 
made under conditions of uncertainty. One must also question 
the sang-froid statements made by experts predicting out- 


comes of complex phenomena relating to threat assessment. 
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(One last remark is appropriate. There exists notions 
that a probabilistic world is in fact extant, in spite of 
mans' inability to perceive it. This notion must be refuted 
because it cannot be defended. No manner exists to refute 
it. That is as Kant set dewn in his thesiss faetseor date 
are not moves of nature; they are in part moves of manking 
forever colored by man's observatory eee. That aks 


can mankind understand some concept completely if it is not 


the product of mankind himself? This is doubtful.) 


O. SUMMARY 

Threat assessment is a complex and immensely compli@aged 
problem today. The problem of properly identifying and then 
assessing threats to this country is magnified in this era 
of standing armies and almost instant communication. 

Historically, possessing weapons almost invariably has 
led to their use. This is passe primarily due to the awesome 
destructiveness of modern nuclear, chemical and biological 
weapons and their highly accurate and dependable delivery 
systems. It seems that countries cannot afford to withstand 
the second strike capabilities of their enemies. 

The notion of threat is a primitive one which is partially 
understood by all men but definable by none. Today no gen- 
erally acceptable definition exists that allows one to attempt 
measurement of the concept of threat. In addition, no method 


is operational to value predictions about threats present 


46 Ciuc imaryo pee teres >. LOO 
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and/for future, that is operational to the extent that errors 
can be detected and associated with threat predictions. 

The process whereby present Defense Department analysts 
eeeess threat has nev been Gecumecnired.  temcalcl iemeal es 
that if these methods were discovered they would be without 
benefit of a theory or operational theorems. 

Analysts oftentimes fail to include the results © f@easc 
Pmtodoloetcal inguiries in their construction of the@rites 
and/or methods. This failure is due in part to the wide 
communications abyss between analysts (knowledgeable of 
present day science) and professional philosophers (possessed 
of knowledge of the history of epistemology and the theory 
of knowledge). This communications problem not only exists 
between philosophers and aeaaaeee It 18 a Salient feature 
of the relationship between traditional threat assessment 
agencies and defense analysts. 

Systems analysis is in use today producing answers that 
are in need of a theoretical back-up. The assessment of 
threat is an important step in this theory development be- 
cause once a threat estimate is made the remainder of the 
moeysis 15 buait upon this foundation. 

The analyst attempts to solve problems that were nominal- 
ly dealt with by social disciplines in the past simply be- 
fuse ene analyst is asked by decision-makers. Thus, role 
disorientation results when the analyst embroils himself in 
areas of other disciplines where he oftentimes oversimpli- 
fies. Through this oversimplification technique, the analyst 


usually handles complex phenomena nicely. So nicely, in 
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fact, that he convinces his decision-maker of the merits of 
his study. Therefore, the analyst inadvertently assumes the 
role of decision-making. 

Concerning measurement, systems analysis generally has 
not benefited from other disciplines with similar problems. 
Analysts usually construct their own methods of measurement 
without use of previous work in the particular area in 
Question. 

National defense policy is generated by the interaction 
of value judgments and the costs of military forces sand 
weapons systems. It is not clearly understood that these 
judgments»are.in partethe nature»of systems analysisueAll 
too often analysts shy away from statements of how they value 
concepts. Without lucid explanation of how one values to 
accompany one's assumptions, decision-makers are denied the 
act of assessing the validity of any system of valuation. 

Presently rhetoric is generated concerning what 1s best 
for the American people in relation to their defense. The 
translation problem associated with what is best for their 
defense has not been resolved. Once threat assessment is 
accomplished the translation problem will disappear. 

High level defense decision-makers must use analyses 
without knowledge of how they were constructed because of 
inadequate interface with the analysts who serve them. The 
decision-maker who acts on a study is not allowed the knowl- 
edge that the study is a translation, a personal one peculiar 


to the.systems analyst who constructed it. Therefore, @@e 
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study. cannot reflect Ghe personal pepepectayec eo aie 
decision-maker because of the lack of interface with the 
analyst. 

The classic almost irreplaceable vehicle for systems 
Studies is the scenario. The scenario drives the analysis 
Sceerorl. ocenarios are assumed devels of Unreal omen, 
level of threat (different scenario) one has a different 
Gevimal solution. 

Woday the abidity to quantify threat without development 
@uemethods to push these quantifications into the future will 
invalidate studies that are not related to future time peri- 
Geo, Without proper temporal considerations a particular 
Semeesis that is absolutely correct in one time period may be 
Sicely wrong in another. History suggests that a temporal 
threshold exists with regard to threats, weapons systems and 
femeeeowes. Ihese thresholds have nov been investigated. 

Wee cetense planner is concerned with uncertainty and 
tjiemaolLlity to handle it properly. The dependency aspects of 
Weemeecintvy are difficult to perceive. Until it 1S possible 
tO perceive how dependency functionals are constructed, un- 
Cepeainty will cost. How much uncertainty costs cannot be 
Peeecrutlly determined. Scenarios implicitly fix threat uncer— 
muedey ranges. For the purposes Oe leis. jj Tle See ih 
feememr os was disregarded due to their inability to handle 
Picmocpendency aspect of uncertainty ranges associated with 
Mia. the recognition of Uncertainty associated with 
Omecay remains a diificult problem, Further investi gation 


into claims made by the social sciences is merited. 
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Pee bir aLeewormey iTS eset —theoret ie and sibjerr ive 
forms is now used in present assessment and each is weighed 
the same. Unless serious effort is attempted concernaima ene 
most feasible methods to use these two diversely developed 
probability measures, studies using both measures are surely 


inconsistent. 
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VI. METHODS 


section VI of this paper concerns 1tseee Wii aoe oaods 
that attempt or can be used to assess threat. These five 
methods do not form an exhaustive list of methods; rather 
these methods that exist in relation to threat are represent- 
ative of particular philosophic standpoints (or perspectives). 

It is anticipated that if a method of threat assessment 
could be constructed for use by analysts the method would 
draw information from the five perspectives dealt with in 
Pee oection. Four of these five areas merit investigation, 
the fifth area is the systems analytic approach. 

The purpose of this section is to briefly present a 
general outline of four of the methods and make only brief 
comments about the fifth method. 
eee POLITITCAL—-MILITARY METHOD OR THE METHOD OF ASSUMPTION 

AND EXPOSITION 

Examples of this sort of method of threat assessment can 
be found in many sources. The most noteworthy are found in 
tiem aval-Institute Proceedings, Brasse's Annual, The Army 
Weeezene, The Military Review, Foreign Affairs and The Marine 
Pelee Gazette. Im addition, political-military commentators 
of major newspapers and major communications networks prac- 
tice this type of method. There are also numerable books 
fied With thms type of analysiee 

The political-military perspective usually takes a 


hypothetical aspect of threat and then spins out logical 


fer 


COMecemencesetrom this impressionistic basis. This. method 
iene vocke iit hatmuematmis at convincing the listenermor 
Eneésmeadereat thesaucghor's point..of view. The, following 
examples of this method represent typical political-military 
threat assessment methods. (The following examples happen 
to have been taken from the 1969 volume of Brassey's 
ines ye 

From an article entitled, "The Defense of the Central 
Region of NATO" comes this example: 


The Threat. There is a substantial body of opinion 
in high-level United States official circles which sus 
gests that NATO has for years been substantially over- 
rating the Soviet threat to the Central Region and the 
Soviet superiority in conventional forces in partigusiaee 
Former Defense Secretary McNamara in a testimony before 
Congress tried to point out that assessments of the 
Warsaw Pact land-air order of battle were conceived on 
far too narrow an analyses. He indicated that @ greaz 
many factors, other than purely manpower, had to be taken 
into account such as training, equipment, reserve 
strengths, etc., before a true assessment could be made. 
The McNamara intervention came at the time when the 
previous U.S. Administration was working hard to per- 
Suade European countries to increase significantly their 
conventional forces in order to give time for nuclear 
decision-making, and that given a reasonable increase 
the Soviets could be held by conventional means alone. 
Whilst there may be some sense in the McNamara view that 
NATO should analyze the Soviet-Warsaw Pact order of 


battle more professionally, there is no getting away from 
the fact that with the amount of force at the behest of 


the Soviets, and accepting they would be the aggre am 
there is no doubt that they could produce a crushiamg 
superiority of force at a time and place of their own 
@lovelers aligyesr 


47 Moulton, J. L., Barclay, C. N. and Yooe, W. M. sam 
Brassey's Annual The Armed Forces Year-Book 1969 (William 
Clowes & Sens, Lidiew1 969). 
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There is another aspect of the sthreat wWortheconsid= 
ering, and at is that. tne Wearsavg! ecpe cw aie wore 
operating Russian equipment—a useful common denominator 
when compared to the hotch=-potch available to NATO. So 
the overall threat remains?) réeécardieeeso! few erie i c— 
mres are™maneuvered™ In a2 speocn tear] et iets ete au 
Munich, United Kingdom Defense Minaster Denis Healey 
made the point: 

What is clear is that the Warsaw Pact had 
advantage 1netwo pare leuler respeetcmson ore 

as VoLrendersdeube tulbeathy=prospe Cope dar. AL 

Might have of Tuten Up @=a siccess Ul conven 

tional defense for more than a few days. 

These advantages warce mumbers of tanks and 

surprise. The Warsaw Pact outnumbers NATO 

in tanks by more than two to one in peacetime 

Ange Ve —/2 COronecwalter mobilization: 
tis obvuously gives them a great advantage, and no 
BOUT Ot wma o—ti ete wean alter these Tacrs. 
(Underscoring mine) 





One sees that the author has (through some method of his own, 
which he does not discuss) valued "the amount of force at the 
behest of the Soviets." This "amount," assuming the Soviets 
"would be the aggressor," "would produce a crushing superi- 
ority of force." This rhetoric is aimed at rebutting the 
expressed views of McNamara. This aim could have been accom- 
plished from an analytical point of view had the discussion 
Petmeed up the method used to value the amount of force 
M@esescsed by the Soviets and the logic used to assume the 
Soviets would be the attacking power. 

From the same publication one finds a second example from 
em@merricle entitled, "NATO's Northern Flank": 

Siieseciilic” Mec iletaye, | bg iwllis so ela - a sig 
eo Reigessreic is Meme mageeyyels 6) lela weenie cel sek clots 
eoengoe rometrme Balticwand at the same time to 


Secure su Ne wish a aon oie D1 S romeo Ope ico lO meadmc ou Ccid 
Conve inenwerr Europe. 


48 Ibid., Bandusiae, "The Defense of the Central Region 


eeeNaTO.” pp. 48-49. 
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With @ proper command organization in this area, 
Suen ace vaewone which as now firmly established, it 
is possible to exploit to the full the defensive 
capability of both the German and the Danish forces 
available. They are mutually dependent of each other, 
and proper coordination has been made possible through 
the joint Allied command.. 

From a military point of view, it does not seem 
likely that an attack against any part of this area 
cout be camried out wathour inmvolvines the sborces 
of the Central Command. The aggressor would have 
to regard the forces of NATO as an entity. If he 
attacked the forces in Denmark and/or Schleswig- 
holstein, he would have to reckon with these forces 
being supported by powerful forces of the Central 
Command and must plan accordingly. The defense of 
this area cannot, therefore, be considered in isola- 
tion, and it would not be@eerrect to measures tae 
isolated strength of the Northern Command forces in 
this area against that of a possible aggressor's 
without taking the whole of NATO's strength into 
account.49 (Underscoring mine) 


Again one sees that it is difficult to ferret out the method 
or reasoning whereby the author takes his particular stand. 

Language such as "an aggressor's aim might be" can be 
translated to scientific jargon as "the assumption of this 
study is," although there seems to be no datum present to 
Support this assumption. The selection of what the "aggres- 
or's aim" might be is critical to the remaining arguments. 
in addition, if one substitutes "prevent control" for =a 
control" in the article the consequences are logically much 
different than the author constructed. Lastly, the paragraph 
heading "strategic assessment" could do more justice to the 
argument if changed to "a possible assessment." 

As a last example of this sort of threat assessment an 


article entitled, "The Soviet Strategic Offensive and the 
NATO Southern Flank" is cited: 


49 Ibid., Koren, C., "NATO's Northern Flank," p. 69. 
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There are some who doubt that NATO naval forces 
can survive in the eastern Mediterranean and some 
who go so Tar as to belie verre Sur aay a) vies 





in the Mediterranean will be impossible. There 
certainly are real threats which suppegessuch 
jnversohetehalce 


There is little doubt that the Soviet anti-ship 
missile force is. ingended ori mariwng et osclvlach sand 
elliminate U.S. a@ireraft Carricrs. Uiewen Same, cemol 
that this 18s a formmdabdile and highly effective suewce 
when operated as an integrated system employing sur- 
face ships, land-based aircraft and submarines in 
coordinated reconnaissance, surveillance and attack 


Meerations. oixth Fleet and aliied@maval power sur— 
Vival will demand that this missile system be dealt 
mech ouriekly and decisavely,. Past experience aadi— 


cates that Soviet missile-equipped naval forces will 
eiaaqow NATO ferces continuously and at close range 
beer any and all circumstances. Prudence dictates 
Pig Ule cOviclLommusuetearieyo understand thay this 
meme Oorulrcularly Unnealuny Cecupatiloneror enelLr 
feosi lestorces. ~Inastimes.of tension 1 is reasonable 
to consider that close surveillance within effective 
missile range by heavily armed naval forces is highly 
mreovecative and willbe dealvewitrn aceordmely , even 
mon ohee point Of destroying offending forces if the 
Penieral Strategic and tactical situation has degen— 
erated to the point where open hostility appears to 


eaeimminent., Lacking such resolve, the ability or 
our forces in the eastern Mediterranean to survive is 
Guestionable. hese statements are not intended to 


peeeue that Since survival is questionable the force 
m@euld not be exposed. Rather, the intent is to argue 
that the western powers must maintain a favorable bal- 
emcee OF DOWer Not Only from the standpoint of quantity 
ema Gguality but a@iiso from the standpoint of the will To 
Mee the naval power to maintain COmmand of “the sea in 


mee hace Of any threat within the enmbire spectrum of 
naval Taam (Underscoring mine) 
Again this particular author's phrasing implies that the 
Miteeoes me discussed are in no way implausible. Further, the 


reader gets no indication of how the author arrived at his 


Comewusions. 


Be [bide Fonworcth hs. Lie toes Geer ceri C “Olea smmre 
and the NATO Southern Flank," pp. 79-80. 


1) 


iii to mereeiToMm principle characteristics, attached to thie 
school of threat assessment. First, the author assumes a 
particular aspect of threat. He uses this aspect as the 
perspective from which he spins out his discourse. Secondly, 
he carefully constructs a predictive environment with his 
own personal methods. Thirdly, these methods are never fulae, 
explained and usually are not referred to in the assessment 
process. The fourth characteristic is a resulting Seu on 
tight and neat arguments designed to convince the reader of 
the author's perception of future consequences. Thus, one 
has an exposition of the logical (at least from the author's 
point of view) consequences that might occur given his 
assumed aspect of threat as a basis. 

An analyst sees many shortcomings in this sort of assess- 
ment when trying to determine how to use it in an analyauce 
It is difficult to,attach magnitudes. It is. also difiveme. 
to value the assessments because of the lack of methacaiee 
gical discussions. Finally, it is difficult to use thtea 
of assessment in a sensitivity analysis because it seems to 
be a point estimate of threat level (although this is not 


clear). 


B. PSYCHO-POLITICAL METHOD: THE CASE STUDY APPROACH 

The psycho-political philosophy dramatizes the ingress 
that the social sciences have made in the defense establish- 
ment in relation to threat assessment. Although chis 
particular school's unique methods of analyses are not 


mathematically rigorous, it probably has more valid 
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contributions in need of proper interpretation than any other 
discipline today. (It is problematical to ascertain when 

the language of communication between the social sciences 

and systems analysis will develop to the extent that full- 
ledged cooperation can exist. It seems most predictive that 

mathematics will likely serve as the principle mode to fur- 

ther this cooperation.) 

On the whole, social science places emphasis on qualita- 
tive research. Therefore, social scientists naturally use 
Gits approach with respect to threat assessment. AS a 
vehicle for discussion of this method a study entitled, "The 
Crisis Management Research Project" was selected to abstract: 


Necessarily, this investigation emphasized the 
influence of military factors on the psycho-political 
processes of international relations in the Cold War. 
One may, of course be reasonably certain that strate- 
gic factors influence the thinking of decision-makers 
in some manner, but this kind of understanding is man- 
ifestly inadequate for the analysis and making of 
national policy. To analyze a government's foreign 
mempey, answers to the following questions are meeded: 
Exactly who is influenced, in what direction, by which 
fiitary factors, and under what circumstances: What 
psychological processes are at work in the minds of 
individuals presumed to be "influenced"? Has U.S. 
Seravesic superiority contatmed communisy expansion, 
iogeeineg the Soviets to conirony sebei woo snwerenal 
crises, thus bringing about a detente? Has U.S. stra- 
mecic Superiority tended to remove Soviet ineentives 
to crest international incidents and tension? How 
@oes strategic Superiority communicate Avsel?r or, 
rather, "get communicated" to opposing foreign policy- 
makers? What mix of strategic and tactical operations 
@eedibly communicates toa potential Vageressor the 
resolve of the United States? The Crisis Management 
Research Project has sought to examine these and related 


ae 


ul: 


problems and to provide some solutions to them. 
(Underscoring mine) 


Contrasting this method Co the political-military method 
one senses a more rigorous approach to threat assessment. 


Assumptions of the Project. The fundamental 
intellectual perspectives of the Crisis Management 
Research Project may now be summarized: The power 
and security of the nation-state, and the objectives 
iG purports vO achitevesor Cnhance resulv’ in interac 
Cions with other nations. The objectives which are 
defended or pursued by a given nation are defined by 
men representing the policy or state. Those who 
act with authority in the name of the nation are 
referred to as "decision-makers". Crises are initi- 
ated, or recognized, prosecuted and resolved by such 
decision-makers. To manage crises successfully is to 
influence the decision-makers or other countries in a 
favorable manner. 

The conduct of decision-makers, is, at least in 
part, a function of their perceptions about the capa- 
bilities, actions and intentions of others, their own 
values and perceived capabilities. These perceptions 
are, in part, a function of the personality and 
attitude set of the decision-makers. 

The central purpose of this project is to evaluate 
the influence of strategic forces on decision-making 
during the management of crises. The models and 
methodology of this project were designed to incorporate 
conceptual clarity, scientific rigor and systematic anal- 
ysis in order to facilitate further verification Giggae 
study and its findings by others.2¢ (Underscoring mine) 


The explicit statement of the study's assumptions leave little 
doubt in the mind of one especially familiar with the jargon 
of psychology and sociology. Perhaps systems analysts in 


their discipline cannot tolerate the lack of operational 


ot Kintner, W. R. and Schwartz, D. C., "The Crisis Manage- 
ment Research Project," A Study on Crisis Management, Foreign 
Policy Research Institute, University of Pennsylvania for the 
Director of Plans, as an augmentation of Contract No. AF 
496382349 (University of Pennsylvania, May 18, 1966), pp. 
11-2 to 11-3. 
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definitions and the substitution of verbal vice mathematical 
explanations. Fer example, the pUr@ese GM Bhe project was 
"to evaluate the influence of strategic forces" might trans- 
late for a systems analyst as "to measure the range of the 
threat of strategic forces." After substituting for 
"influence," "the range of threat" an analyst would then 
Semon tO operationally define what Chreat of Strategic forces 
emuailed. 

The declaration of assumptions and the use of concepts 
Seommne a primitive meaning is the approach of this method. 
This approach however, is several magnitudes more rigorous 
than the political-military approach. 

mne qualitatamve nature wa this philosophy is a product 
meeenec Craining.of the sscientasts using at. 


It may be well, at this point, to stress the 
essentially qualitative aspect of this research. 

Our indexes should not be taken for sophisticated 
seabes. Yet, they do convey some basic changes in 
perceptual variables and provide the basis for 
determining any patterns the variables assume in 
Crisis decision-making. 

Kach of the following perceptual factors were 
treated in the same way. An index of factors or 
information on which the perception was assumed 
to be based was developed. The project staff rated 
the degree to which the index would support a govern- 
ment's perception of the variable in question. 

7. Level of threat-"Threat"™ is more direct and 
specific than "tension" and more observable than 
"stress." Our index for threat was based on the 
semantics of crisis communication (e.g., "serious," 
"erave," or "awesome") and situational fears (immedi- 
ave nuclear attack on homeland, loss of bloc partner, 
loss of strategic base, or loss of prestige). 

Perceived opposing hostility 

9. Perceived likely allied response to crisis 
Oe CY oo “5 pe 
1Q0. Perceived likely neutral response to crisis 
Oe eC ors” ‘un. 

ll. Perceived likely reaction of citizens to 
Cees Pe luncy 


io 


12. Number of alternatives 

13. Receptivity to communication 

14. Centralization of decision-making 

15. Degree of change in established doctrine 

16. Intelligence 

17. Number of powers involved 

18. Directness of confrontation ; 

The basic method of research was to assess values 
of each independent and dependent variable in each of 
the three selected phases (initiation, peak, and 
resolution) in each of the crises under resolu@ion) in Caen oOfmebhe crises under study. Ali 
Variables were weighted on a 0-10 scale. The nature 
anGmdiwectionvoie chances in cCachavariable through 
time were then apparent. Observable regular changes 
in each of the fifteen dependent variables were cor- 
related with each other and with changes in the three 
independent variables. Similarities of directional 
change between the independent and the dependent 
variables were interpreted as variations in the per- 
ception of strategic factors during crisis decision= 
making.23 (Underscoring mine) 


The terminology of these types of studies is of specific 
meaning to scientists versed in psychology and sociology. 

The "0-10 scale" in this particular article is in the realm 
of the systems analyst and its mention reveals the first 
major drawback of this sort of study, the lack of mathemati- 
cal rigor. The measurement of the variables, all on a "0-10 
scale" make implicit assumptions. To begin, a 0-10 scale is 
assumed arbitrary and therefore, ordinal. Also, it is not 
clear that the "12. number of alternatives" and "13. recepti- 
vity to communication" variables can be measured on the same 
scale, or necessarily an ordinal scale. That is, 1sSieuea 

for "12. number of alternatives" equal or of the same signif- 
icance as a 5 for "13. receptivity to communication"? One 


would think not. This type of naive mathematical reasoning 


23 Thid., pp. 11-16 to 11-17. 
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is generally characteristic of this@method™ (Mieslast para-— 
sraph of thesquote tales maboul weorrelat one o! sdemonCemlasand 
independent variables with themselves and each other. 
Minother this is correlation in a rigorous (mauhemarical) 
semse is not clear, df stagistical coreclationewaswusecd 
then the significance of parametric statistical methods 
applied to ordinal data is questioned.) 

The model used in this school reflects this mathematical 
naivety and is usually a way of thinking about the problem 
2s, Opposed to a rigorous model. It may be that the concepts 
involved in threat quantification are so little understood 
that mathematical model development is impossible at this 
time. This remains for future investigative effort. 


The modei which suggests the selection and 
integration of these variables is an attempt to 
synthesize the major theoretical approaches in 
international studies. From traditional assump- 
tions in international politics, for example, the 
notions of threat capability and use of weaponry, 
have been taken. Thus, we can test the basic 
hypothesis that foreign policy makers act in order 
TO maximize utilities. We are aware, however, that 
what 1s to be maximized is a function of basic 
values and goals. 

ie. Ties t PON alasor Liicesiae LO Beare Oiee aol ail © 
international politics suggests the concepts of 
Pera liZatlongedeCchprimec, alideant cig ceoncoue Tiece 
eoncepts are meaningful perceptual terms. The 
mesvponses.of allies; nmeutrals, citizens, ete... wil 
Peiecy the adoption of policies which derive from 
Senuralization, doctrine and intelligence. 

From these general considerations, a set of 
concrete interrelated hypotheses were derived and 
tested . . . Some of the major hypotheses of the 
Crisis Management Research Project are suggested 
relationships between the perceptual variables in 
the model of crisis decision-making discussed earlier 
in this chapter. Here, we state these hypotheses, 
Show how they derive from theory and observation, and 
Pet@ecxatiime che limits sol ohemre ral ranoy . mel Dicede te 
some of the basic general relationships between 
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pete ee 71 Ceerocpaceeiactors sand crisis.decision-— 
making are set forth. (Underscoring mine) 


Here is the point where the political-military and the psycho- 
political philosophies start to parallel one another. At 
least, from this point on the psycho-political school uses 
the same method as the political-military method. That is, 
after the social scientist produces statements concerning the 
assumptions, purposes, definitions, and hypotheses, he then 
logically carries the reader to several conclusions through 
the use of his discourse. 

The specific allegations of the political-military anal- 
yst do not appear in this method. In this method's conclu- 
Sions one sees the more conservative scientific demeanor of 
the psycho-political practitioners. 

General Conclusions. We do not assume that 

strategic superiority can solve all crises or that 

escalation theory can completely explain them. 

strategic superiority needs to be communicated to 

be eifective. Escalation calls for interpret ation 

In brief, the threat of future strategic actions 

must be credible. 

Ne pUIOCSe OF ~ehils Study teutonet acu irae 

assessment of the credibility and communications 

requirements of crisis management.292 

The general nature of this school of threat assessimeme 
is characterized by the case study. After setting down their 
purposes and assumptions in detail, trained scientific ob- 
servers collect data. Then hypotheses (after observation) 
are constructed and "tested" in relation to what was observed 
(in the language of the example, "here we state these 


54 thid., pp. 11+17 to 11-18. 
22 Ibid., pp. 11-22. 
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hypotheses, show they derive from theory and observation, 
and then examine the limits of their validity"). 

The disadvantages of this method in relation to systems 
analysis are its nonmathematically rigorous nature and use 
eervocabulary that as Seeeriic CO auch develoued 
aoc p line, 

The deficiencies of the method from an analytical point 
of view are parallel to the political-military method. The 
measurement of the assessment process takes place in the 
minds of men and it is extremely difficult to place magni- 
tudes on the evaluations in these studies. (Since this method 
presents several alternative states of the world in its con- 
clusions, if one could enumerate the studies! assessments, 
sensitivity analyses could be accomplished. This would be 
difficult using the political-military approach.) 

The manner in which social scientists derive their hypo- 
theses must be questioned. Who is to say that the implanta- 
tion of these hypotheses is not the ulterior motive of an 
enemy power? That is, if one derives his hypotheses for 
"testing" as the study states from "theory and observation," 
then the observations are necessarily the moves and counter- 
fewes Of the enemy. To restate the question, how can one be 
sure that these hypotheses are not elaborate plans construc- 
ted by those one observes? How does one determine the inter- 
actions between observer and observed? This cause and effect 


relationship directly affects the value of this type of study. 
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It seems that until one can determine the interactions 


involved one cannot value this method in a proper manner. 


C. BEHAVIORAL MEASURES-CONTENT ANALYSIS 

This philosophy of threat assessment is in part a product 
of the social sciences, the behavioral sciences in particular. 
There is one difference: the behavioral scientists who par- 
take of this type of analysis use statistical procedures 
to reach their conclusions, unlike the psycho-political 
approach. These statistical procedures are called statis- 
tical pattern recognition procedures in systems analyVomen 
(For an especially vivid explanation of this method of 
Federalist, [Ref. 15]). 

Statistical pattern recognition is a method of deduGwae 
patterns or signals in a data stream over time through the 
use of statistical decision theory and probabilistic reason- 
ing. In the case of the behavioral measures method of threat 
estimation certain words or phrases or groups of words are 
selected by the behavioral scientist as representative of a 
particular concept. Sample data-streams are studied to em- 
pirically determine the distribution of this concept through- 
out written or spoken matter (if this is not feasible a 
distribution is assumed). Once this distribution is deter- 
Mined. or assumed, Statistical regions of accepraie son 
rejection are determined based on Types I and II errors 
selected by the experimenter through his use of decision 


theory and its logic [See Ref. 6]. With these tools at hand 
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the behavioral scientist can insert entire texts of messages, 
writings, articles or speeeites ite eiiiG aco iO tesa feel 
is interested into @ Statiseicalseenpul eae orice cea las 
program is designed to test Stari sraeal ys caer ew presence 

of the concept. The scientist's selection of the words or 
phrasing as representative of a concept is much like setting 
Memomocale. The more Subdivisions of the comeepe, the finer 
one is able to "measure" the level of the presence of con- 
eeptual patterns. 

Patel iy tal semeunedn Ss wermMmed seOmv en ura alevsEls sadeeu mle 
behavioral sciences. There are several methods of applica- 
tem Of This analysis not necessarily involving the use of 
a computer. The term thematic content analysis (thematic 
@Cemamed as: of or relating to the stem of a word or @onsti-— 
tuting a theme) is usually applied to written material. 
Pem@uent analysis is applied to visual material. The history 
Seeeconeeniy analysis is a long one but the application of 
mrmrselcal pattern. recognition, procedures in conjunction 
with content analysis is fowel 2 

Loubert and Stacey [Ref. 27] in their review of five 
of the original papers using statistical content analysis 


comment on the complexity of the problem of assessment and 


56 Foubert, J. Dienetaracey- ec. Hee Projece Mi chelseon 
Studies of Communist China: An Examination of the Relevance 
of Selected Findings, A technical report prepared under 
fem@imicact for Group Psychology Branch Psyehological Sciences 
Division, Office of Naval Research, HSR-TN-6613-CS (Human 
mewences Research, Inc., July, 1966), p. 1. 
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Pring up a fundamenval question concerning the method of 
statistical content analysis: 


After careful examination of the various studies, 
it became apparent to HSR [Human Sciences Research, 
Inc. ], analysts that the authors were wrestling with 
a particularly difficult problem in the behavioral 
analysis of political affairs. In dealing with spe- 
cific events (crises) where a minimum of reliable 
information is available, how can we move from even 
the simplest level of abstraction to an evaluation of 
the "reality world" of one of the principal actors? 
In the North series, the authors apparently were 
using the following adaptation of the classical S-O-R 
paradigm: The crises are the Stimuli, the Peking 
leadership is the mediating Organism which evaluates 
the crises through its perceptual filters, and the 
Responses are the official statements which purportedly 
describe these perceptions and announce Peking's re- 
actions. In the McClelland studies the Responses 
included both Peking's statements and physical acts 
(Attack, Withdraw, etc.). As such, the McClelland 
studies appear to provide greater assurance of re- 
ivability Sinee discrepancies Detween threats and 
acvurons can sned light on bluffing tactics. In BG@ie 
studies, additionally, the authors studied the actual 
cerises to determine if the facts supported or discon=— 
firmed their quantitative findings. 

The fundamental question still remains, however: 
"With necessarily fragmentary information of the 
circumstances involved, can the authors of these 
studies move from the measurement of Chinese hostility 
to an explanation of its causes? 


(Underscoring and comments in brackets mine) 
The shortcomings of this method are clearly pointed out by 
Loubert and Stacey: Can the causes of hostility or threat 
be fegreved Out of writven or yusual material? Can behavioral 
scientists isolate the unintended messages contained in 
official communications and the implicit patterns underlying 


official interactions between nations? 





2! Ipid., p. 4. 
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Loubert 400664 cea Gyn eene1 tee adeaee 


Despite the many problems which beset the novel 
approach to the analysis of international relations, 
the studiessot Northywet salsa nce Clee Cacia 
Contain prelimimiewy Indvenelomsmm@aay Veleanvalor a) 
scientists can take ordinary published materials from 
open sources, subject them to sophisticated statis— 
tical analysis, and come up with potentially valuable 
PISlents Ore soci stonm—Mmakcrs aicmbne liemoaUO WO os bdr itc., 
They can do this because they are looking for and 
finding the unintended messages contained in official 
communications and the asmplascit patterns of inter- 
Weaeronal actions. Altunhovlehn the present srave of Une 
art is notesuchmasmito-produce.results, whaiehe canmbe 
used with confidence, such insights into the behavioral 
patterns of foreign leaders can becomesvaluable, to our 
decision-makers, to the extent that their validity and 
reliability is demonstrated. In any case, the authors 
of these studies should be commended for demonstrating 
courage in addressing themselves to the most complex 
Meect (crises) Of international relarvons .>2 


The shortcoming of this method, in the eyes of systems anal- 
toes, 25 that of communications. The scales that behavioral 
scientists construct do not reflect the purposes of systems 
analysts. The relative or absolute magnitudes of the concepts 
involved are not determinable without communicable scaling 
procedures between disciplines. Again as in the psycho- 
political approach, the highly developed jargon of behavioral 
scientists does not convey the same meaning to systems 


analysts. 


D. SUBJECTIVE MEASURES-EXPERT OPINION QUANTIFIED 

If one accepts the premise that learned men in a parti- 
cular field (or so-called experts) can be harbingers of 
future events of their particular discipline, one agrees with 


58 iemkel | 10m 
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this method which also accepts this hypothesis. 

In this context, subjective measures means the use of 
mens' minds as measuring devices in a methodical and repro- 
ducts awe weieto tore 1Tinplicit TO this philosophy vise 
the assumption that the answers or proper measures can be 
solicited from mankind. Of course, this is not an original 
premise, it is as old as man and his decision-making. Men 
make their decisions by mental processes that one would think 
are biased by their total experiences and their present and 
self-predicted environments. 

The most sophisticated decision-makers who use complex 
analyses and answers also implicitly believe in this method. 
Given several alternatives a decision-maker must make a de- 
cision. The valuation of the best decision by the decision-= 
maker is an individual subjective measurement. In other 
words, the decision-maker values alternatives mentally by 
his own unique mental processes. He then selects as his 
altemnative the one Withmltehest” value. 

There exists several methods for dealing with these 
valuations (which will be called opinions here). Campbell 
[Ref. 35], Brown and Helmer [Ref. 29], Dalkey [Ref. 34], 
Gordon and Helmer [Ref. 32], and Maier [Ref. 24], discussed 
methods of dealing with opinions. The method developed by 
the scientists at the RAND Corporation called the Delphi 
technique and espoused by N. C. Dalkey is used here for 


purposes of discourse. 
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The salient features of the Delphi technique are that it 
dampens interactions caused by face-to-face confrontation of 
men in discussions. iltmeallows individualsencr Fosbeesummected 
wo dominant individuals or group pressures weltealso allows 
tiacmmeoduse factor hab crolpwdisecussiemmewe [reser oOmbe 
Ciescarded. 

Dalkey describes his method in a paper entitled appro- 
priately, "Looking into the Future": 


The basic characteristics of the Delphi procedures 
are: (a) Anonymity, (b) Interaction with controlled 
feedback, (c) Statistical group response. Anonymity 
is achieved by using questionnaires or other formal 
channels of communication, where specific responses 
are not associated with individual members of the 
Erolpeew (his ais°a way@ek cutting edewneons ne ei fects 
Siecdeominant individuals amd reducing Some iemercssiire. 
ineveracvtion consists in performing the interact om 
among members of the group in several stages; typically, 
at the beginning of each stage the results of the pre- 
vious stage are summarized and fed back to the members 
of the group, and they are then asked to reassess their 
answers in light of what the entire group thought on 
the previous round. Controlled feedback allows inter- 
action with a large reduction in noise. Finally, 
imeuwner than asking the group to arrive at a common 
opinion, a consensus, the group opinion is taken to 
Heme Sbavuisuical average of the timateopinions of 
individual members of the group. In the experiments 
we have conducted, the median opinion-that is the 
meddle estimate where half the group is on one side, 
and half on the other-has turned out to be the most 
mecurave. BY USINS a SGavisvICca lb fcr oOvOmer ill one 21 OUD 
Pe@cssure toward conformity is further reduced, and 
probably more important, the opinion of every member 
is reflected in the group response.29 


As previously mentioned the subjective measure has been 
the manner by which man has solved his problems throughout 


his existence. Prior to the so-called scientific method 


59 Dalkey, N. C., Predicting the Future (RAND Corporation 
Report P-3948, October 1969), pp. 8-9. 
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men relied on their judgments, whether individual or col- 
ieectdveeme ne conse ructienmof themscientificemethod of 
laboriously presenting evidence supporting one's conclusions 
has judgments as the glue which holds it together, that is, 
men and scientists make qualitative judgments. Judgments 
Polorvall human @@etivity, even science. 

The Delphi technique and the subjective measures philo- 
sophy it represents is a method that carefully uses the 
opinions of men in a manner that can be controlled and 
reproduced in part. Whether the answers to threat prediction 
and assessment can be acquired using this method remains to 
bewseen but as’ Dalkey points out, there is reason ior 
optimism. 

Let me sum up: Opinion plays a baste role im long 
range forecasting of technological and social develop= 
ment. The traditional ways of dealing with opinion 
have significant drawbacks. Our experiments have shown 
that it is possible to design techniques for putting 
the opinions of a group of individuals together that 
avoid some of these drawbacks. However, the improve- 
ment is small. 

The next step is to see whether we can dampen the 
effects of group pressure, in this case excessive 
convergence, and amplify the movement toward the true 
answer. We have to wait on further experiments To 
see whether these are possible, but we have some 
grounds for optimism. 

Although this method has not been directly applied to the 
assessment of threat present or future, it seems a promising 
one because the type of answers can be tailored by the types 
of questions used in connection with the method. Answers 
useful to the systems analyst can be solicited by this method. — 


OT che ee 
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The shortcomings that are anticipated in connection with 
the use of subjective measures are major ones. How does one 
so about selecting the experts to question with the subjec- 
tive measures technique? And if thisSmprobdiemers solgsed jmdoes 
the answer lie in the minds of these experts? Presently, 
these questions are devoid of practical significance because 
as yet no way exists To™verify the method in its present 
crude stage of development. Once a theory of subjective 
Measures is developed, it seems likely that this method can 
play a major role in the assessment of threat. (As a side- 
light the reader is reminded of the problem that was discussed 
mmeerection V, page 53, that concerned them@daterculvy ssysvems 
analysts have presently in interfacing with the decision- 
makers they serve. Subjective measures methods could pres- 


ently have direct application to this problem. ) 


Peo. SL EMS ANALYTIC METHODS 

fc is not the purpose of this section as in the preceding 
four, to outline the methods used by systems analysts To 
assess threat for use in studies by the defense establish- 
fiemij~r lhe task is far too complex to attempt here. The 
factors that complicate such a task are many. First, many 
diverse methods are used and no single method can be used 
Memeepresent all of the others. Secondly, this paper has 
implicitly rejected present methodologies used in connection 
Pee Lhe quantification of threat. ‘Third, since access to the 
decision-makers in high-level defense positions can be ob- 


tained only by dint of the authority of these same 
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decision-makers this access was regarded as impossible for 
the purpose of this paper. Without this access the trace of 
how threat assessment actually takes place today in sehe 
Defense Department must remain indecipherable. 

The purpose of this section is to point up the problem, 
that of tracing how threat assessment takes place in the 
Defense Department, and comment on why it -iseof concer 
(this paper also is submitted to lie in evidence of this same 


problem). 





Prior to the introduction of the planning, programming 
and budgeting system in the Defense Department, the budget 
level for defense was set by the Chief Executive. Secretary 
McNamara's attempt to make the defense budget a numerical 
reflection of political purposes has prompted this study. 
Since the early sixties defense decision-makers have striven 
to provide for the common defense ima manner reflecting the 
threats to this nation. The method that these decision- 
makers use to recognize these threats is not clear however. 
The National Security Council and its members generate policy 
for the guidance of the defense establishment. For security 
reasons the construction of these policies and many times the 
policies themselves are not published. It is questionable 
whether any documentation exists setting forth the mevnoa 


whereby the National Security Council (with inputs from the 





Defense Department, Central Intelligence Agency, State Depart—— 
ment and various other government and private agencies) 


assesses threats to this country. It 1s doubtful thats ie 
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such documentation existed, it would contain the highly 
personal decision processes unique to the members of this 
council (The National Security Council is composed of the 
President, the Vice-President, the Secretary of State, the 
secretary of Defense and the Director of the Office of 
Emergency Preparations). 

It is important that™efforts be made To frill in theweaps 
in knowledge concerning how individual defense policy deci- 
sions relate to the spectrum of threats faced by this 
country, because of the paramount importance of the need to 


Orseover the spectrum of threats to this eeuwntry. 
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VII. CONCLUSIONS, RECOMMENDATIONS AND PROPOSALS 
FOR FURTHER RESEARCH 
A. CONCLUSIONS 

This developmental paper's method has been to use dis- 
course and example to attempt to heuristically define little- 
understood problems. At this time it can be concluded that 
these problems are not only little-understood and extremely 
complex, but that this present paper is woefully incompiier—s 

This paper has used propaedeutic discussions touchimgewen 
many disciplines outside the confines of systems analysis 
because of the nature of the problem researched. To con- 
clude at this time that systems analytic techniques or 
its practitioners will be able to construct a method to 
properly assess threats to this country is folly. It Gaemiee 
concluded that the efforts of many disciplines will most 
surely be needed. 

Further efforts to investigate threat assessment as 
practiced today in the defense establishment coupled with 
comprehensive efforts to document and evaluate these types 
of assessments are needed to form a data-base. From this 
data-base efforts to construct a realistic, pragmatic, and 
effective methodology that would be capable of outlining 
threats to this country could be conducted. To date, docu- 
mentation of threat assessment methods is scarce. Few papers 
deal with this problem as an entity. Once must interpret 


methods from many and varied sources that use techniques of 
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threat assessment as a method to solve what is considered a 
subproblem, inferior to the document's main themes. The 
@enclusion here ais thaw untae oscholarsmeencidewsyaies 

problem by itself and generate research in relation to threat 
assessment, efforts, such as this one are doomed to inade- 
quacy because of the bare spots that are left in the analysis 
that could not be spared any allocation of effort. These bare 
Seous cannot be filled in by others' efforts because none 
Sease. 

This paper has not dealt with the enormous number of 
practical problems that plague defense planners in relation 
to threat assessment. It has never defined threat or assess- 
ment. It has not exhaustively listed present government 
sources that might contribute to a theory of threat assess- 
ment; nor has it listed the possible disciplines that should 
be enlisted in an effort to solve this problem. What this 
paper has attempted to do by side-stepping these very real 
and important problems is to make them meaningful by ex- 
ploration of the structure of threat assessment. Once one 
Cam perceive the structure of the threat assessment process, 
it is anticipated that one can conclude that enormous 
G@ifficuities lie in the path of the investigator. 

The understanding of nature by mankind is of epic pro- 
portions at this writing. Man's understanding of the 
phenomenon of man and the phenomena of man in relation to his 
works is in a crude state of development. In fact, the ages 


of the development of mankind are named after many of the 


s. 


Comserucus of mam because of the vast changes in man's 

life that these man-made items have generated. We have lived 
in the Nuclear Age for a generation but the effects of nu- 
clear fission cannot be foretold by mankind. Heisenberg 
attempted to state his position in relation to how man might 
finally understand physical nature in 1932. 

IT have attempted to show how physics and chemistry- 
driven, we hardly know by what force-have continuously 
developed in the direction of a mathematical analysis 
of nature under the guiding principle of unification. 

The claims of our science to an understanding of nature, 
in the original sense of the word, have at the same time 
decreased. The attempt to prove impossible a perception- 
theoretical understanding of the latter kind, and to 
prove mathematical analysis the only possible way, 
appears to me as unwise as the opposite assertion, that 
an understanding of nature can be achieved in a philg- 
sophical way without a knowledge of its formal laws .61 
Given that man's understanding is in a crude stage of devel- 
opment in relation to understanding the phenomena of man- 
kind related to his works, this paper concludes that no 
method of assessing threat can necessarily be developed with- 


out further progress by science attempting to understand the 


phenomena of man and his works. 


B. RECOMMENDATIONS 


1. Reallocation of Research Efforts Within Systeme 
studies 


Since the estimation of threat seems to be the basis 
for most systems analysts, further effort should be allo- 
cated to discover proper methods of threat assessment. The 


61 Heisenberg, W., Philosophic Problems of Nuclear 
Science (Pantheon Books, Inc., 1952), pp. 39-40. 


96 





crude and over-hasty estimation of threat not only over- 
simplified a complex concepr = ouv ImvaliGatesm cence lie teu 
besed on Such “esGameave ce 

e. Abstract Fundamentals 

Investigationwinvto the abst racer tundament als omerie 

Bmenomena Of threat are needed if rigorous, development of 
models similar to those presently used in systems analyais 
moeever be accomplisned. A most meanimrerul addition to the 
tools presently available to systems analysts would be a 
Peweulus of threat assessment coupled with operavional 
Mmeoarems developed from axioms of the calculus. 

fe ‘Umreeat Assessment Reléevanew ve Fresenv Polivey Planning 

The discovery and documentation of the actual working 

method presently used by the defense establishment including 
Merewvav ional Security Council is a paramount goal. This 
Geeomentation carl find use asa staring point to value 
ewes Or philosophies that already exist in relation to 
threat assessment. This documentation could be accomplished 
with minimal use of resources and manpower. It is recommended 
Mimo rlor. to further researchimvowdiitecempemernodologies 


the present one be discovered. 


C. PROPOSALS FOR FURTHER RESEARCH 
l. Inereasing the Effectiveness of Judgment and Intuition 
Since the defense establishment involves itself in- 
G@eeasingly with problems, with no Known scientific methods 
to handle them, it seems that the enhancement of judgments, 


intuition and opinion of defense decision-makers must be 
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attempted through the use of methods such as Delphi. (See 
Section VI, Part D). It is proposed that research into a 
practical plan for application of this method or a method 
especially tailored for the Department of Defense be con- 
structed. This research could be as basic as the formula- 
tion of a plan of which particular decision-makers should be 
called on for judgments “concerning what general »class@am 
problem. A more complex approach would develop a plan for a 
section or department whose sole concern would be qualitative 
judgment sampling on a permanent scale within the government 
establishment on a par with the various departments. This 
department's job might be to develop threat indexes similar 
to the Dow-Jones Averages. Indexes could be investigated 
and research conducted on how to construct indexes for use 
by the military, the intelligence agencies, the State Depart- 
ment and the Defense Department. It is anticipated that an 
index constructed for the State Department would not be 
compatible with one made for use by systems analysts in the 
Defense Department. 
2. Data-Base Investigation 

To further efforts between disciplines that seem To 
be of Guess eile in the problem of threat assessments, it 
is proposed that the knowledge of human and group behavior 
found in psychology, sociology and related behavioral 
sciences be developed in a form that could be rigorously 
applied. That is, develop operational definitions of con- 


cepts enjoyed in these disciplines, document the general 
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results of pertinent studies already carried out by these 

disciplines in such a form as to be of use by defense anal- 

ysts. This type of research could be of a survey form 

conducted by a systems analyst in conjunction with a 

behavioral scientist. Lazarsfeld points up this problem: 

In addition to traimineeanid crearuiveswork Sbhere 

is a third road. We need investigations which 
clarify in a more general way the possible relations 
between mathematics and the social sciences. We 
should take specific problems and look at them with 
the end in mind of understanding better how the 
structure of behavioral science thinking and the 
structure of various mathematical methods fit each 
other. It is along this line that the Bie ely volume 
intends to make its main contribution.©® 


3. The Conduct of Research to Relate National Goals to 
the Threats to These Goals 


This research would probably be a listing, as exhaus- 
tive as possible, of National Goals. These National Goals 
Mien COULd be related to threats to them. Whe purpose of 
this type of research would be to help canalize Defense 
Department thinking along these lines so that their inter- 
pretation of the common defense in relation to the desires of 
the American people would be adequate. 


Ml Derivation of a Horizon for Predictive Problem 
Purposes 


This research would endeavor to develop a planning 
horizon to use in various predictive problems which concern 
defense analysts. For example, is it feasible to expand 
Tesources to cost~-out large programs? If so, how far into 


Wee tuture is it practical to attempt accurate costing? 


62 Lazarsfeld, P. F. (ed), Mathematical Thinking in the 
Social Sciences (The Free Press, 1954), p. 5. 
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Is there a cost horizon that beyond this time little can 
be gained in attempting to estimate project costs? 

time coreuson = rescarecn Can concern itself with cosw 
horizons, contingency plan horizons (for example, is the 
five year time frame a feasible one for the five year joint 


strategic plan?), and program effectiveness horizons. 


5. Meta-Logic for Threat Assessment 

As the final proposal for research it is recommended 
that investigation be conducted into why certain method(s) 
is (are) necessarily the correct one(s) to apply to the 
assessment of threat. 

For example, simulation techniques on high speed 
computers were developed to get answers to problems that 
would have been astronomically expensive if trials had been 
attempted from which to extract data. The validity of 
simulation methods are in question today while their verifi- 
cation is relatively simple. The reason is that a meta-logic 
to construct the logic of simulation has not been formulated. 
Therefore, validating a simulation with respect to the 
phenomena it represents is formidable. 

Similarly, the assessment of threat has heretofore 
taken place or been simulated largely in the minds of men. 

If a method possessing scientific rigor can be developed, it 
must be validated that it actually represents the real world. 
This job would be several magnitudes simpler if a logic or 


calculus of threat assessment could be constructed. The 
construction of this logic must be preceded by a meta-logic 
to construct the logic itself. [See Ref. 19] 
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